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This thesis evaluated the effectiveness of sensor fusion — combining infrared and low- 
light-level imagery — to improve the F/A-18 target standoff range requirement. Several 
human performance studies have shown inconsistent results regarding the benefits of 
color-fused imagery. One method to test the validity of sensor fusion is to use 
mathematical models that simulate and predict the detection abilities of the human visual 
system. The mathematical models are derived quantitatively from the image statistics, 
while the behavior data are a qualitative measure of a human observer. This thesis 
developed a statistical analysis to compare and contrast these techniques to assess sensor 
fusion. The four models evaluated were: a Global matched filters, a Local matched filter, 
a Template matching filter, and a contrast-base image quality metric. Of the four models, 
the Global matched filter produced the highest degree of correlation with the human data. 
The Global matched filter moderately predicted which of the single-band sensors and 
which of the fused sensors provided the higher sensitivities despite the characteristically 
different scenes. Although there are many refinements that need to be explored, the 
Global matched filter concept may be used to evaluate and compare the many different 
fusion algorithms being proposed. 
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EXECUTIVE SUMMARY 



This thesis evaluates the effectiveness of sensor fusion — combining infrared and low- 
light-level imagery — to improve the F/A-18 targeting standoff range requirement. The 
Chief of Naval Operations Air Warfare Division (N-88) endorsed this study to determine if 
sensor fusion will improve targets’ definition and clarity, and, in turn, pilot recognition. 
Information theory states that displaying two separate sensors as color differences should 
increase the pilot’s ability to discriminate the target from the background. However, 
several human performance studies have shown inconsistent results. These studies relied 
on a limited set of stimuli, which may have confounded the results. An alternative 
method to test the validity of sensor fusion is to use a two-dimensional spatio-spectral 
matched filter to simulate the behavior of the human operator. The matched filter is 
derived quantitatively from the image statistics, while the behavioral data are a qualitative 
measure of an observer. Both techniques have been used to evaluate sensor fusion; 
however no study has compared the results between the two methods. As a consequence, 
the results are limited within each discipline and cannot be generalized to the other 
discipline. This thesis develops a statistical analysis that can be used to compare and 
contrast the quantitative and qualitative techniques to assess sensor fusion. In addition, 
this study develops a two-dimensional spatio-spectral matched filter model to predict an 
observer’s ability to detect a target within a natural scene. 

Scribner, Satyshur, and Kruer (1993) proposed that combining images from two 
separate sensors into a single “enhanced” image significantly improve users’ target 
detection and recognition. Objects viewed by low-light and infrared sensors will generally 
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have the same spatial characteristics, but appear to have dramatically different contrast 
levels. For example, a pseudo-color target has better scene contrast (e.g., the horizon or a 
tree line is much easier to segment), which should attract the pilot’s attention, thereby 
reducing the pilot’s workload. This is analogous to a ground soldier laser-designating a 
target so that the pilot can easily identify its location. Accordingly, color fusion, as 
compared to monochrome devices, will allow users to quickly orient themselves with 
respect to a scene and detect targets with greater accuracy. 

The intent of the matched filter technique was to model CAPT Matthew Sampson’s 
USMC thesis data (1996). Sampson found that aviators’ accuracy for detecting a pseudo- 
color target was equal to that of either the infrared or image intensified target. However, 
there were significantly different levels of performance across the four sensors for each of 
the scenes. Aviators could quickly detect a pseudo-color target within one scene, but 
failed to detect the pseudo-color target in a different scene. The three scenes used for the 
human factors testing each exhibited characteristically different proportions of emmissivity 
and reflectivity, which would greatly influence the aviators’ detection of a pseudo-color 
target. This limited set of scenes could account for the wide range of detection ability and 
the inconclusive results. 

A two-dimensional matched filter array can be used to determine the presence or 
absence of an object within an image. Scribner, Satyshur, and Kruer (1993) used the 
matched filter to predict an observer’s ability to detect a target within a natural scene. 

Their results showed that a pseudo-color target was superior to single-band infrared 
targets. The advantage of the matched filter technique is the ability to predict an 



observer’s detection rate across multiple scenes. The validity of this technique depends on 
whether the matched filter accurately predicts the detection rate of a human observer. 

This thesis tested whether a two-dimensional matched filter or contrast based image 
quality metric could predict aviators’ target detection ability for the following sensors: 
Infrared, low-light image intensified, combination of low-light and infrared with a 
monochrome output, and, combination of low-light and infrared with a pseudo-color 
output. Three still images were used from an early prototype fusion sensor system 
developed by Texas Instruments and the Night Vision Electronic Sensor Directorate 
(Palmer, Ryan, Tinkler, and Creswick, 1993). These images were collected from a low- 
light visible image intensifier (,6-.9pm) and a first-generation forward-looking infrared (8- 
12pm) mounted on a UH-1N helicopter. Images were collected during starlight (10' 3 lux) 
to full moon (10 _1 lux) conditions. 

The matched filter used for this experiment is a spatial filter optimized for a target’s 
signal to noise-power, which is shifted to several locations within an image. At each 
location, the filter’s coefficients are multiplied by the pixels that are overlaid and summed, 
providing a measure of the correlation between the overlaid scene and the target. By 
evaluating several background areas of an image with, and then without, a target present, 
the filter’s signal-plus-noise and noise distributions may be estimated. These empirically- 
derived distributions can be used to estimate the matched filter’s ability to “discriminate” 
the target from the background noise. This ability to “discriminate” is expressed in the d- 
prime (d') sensitivity convention of search detection theory, facilitating a direct 
comparison to the sensitivities of the human subjects. 

xiii 



Results of the ANOVA analysis indicated a significant difference between the 
performance evaluations of the matched filters and the human subjects. However, 
graphical analysis of the resulting sensitivities showed that the same trends in the human 
subjects’ ability to discriminate the target from the background are also reflected in the 
sensitivities produced by the matched filter. Although regression analysis showed highly 
significant regression coefficients, the highest coefficient of determination was for the 
Global matched filter at 3 1 percent. However, in almost all cases the matched filters were 
able to correctly predict which of the sensors provided the worst detection rates. 

Since these models are based on the human visual system and should be 
comparable to the detection rates of an aviator, they can be used to evaluate the various 
sensor fusion processes. The matched filter has two advantages. First, it quantifies the 
degree of “enhancement” achieved by a fusion process, thus allowing for direct 
comparisons of the various sensor fusion techniques. The second advantage is the ability 
to predict human visual performance under a variety of environmental and terrain 
conditions. 
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L INTRODUCTION 



Within the last decade, the conceptual template of the U.S. military’s fighting force 
has dramatically changed. In the past, the United States Armed Forces were built around 
a core set of capabilities relying on massed forces and sequential operations to handle 
domestic, regional, or international demands. In the future, the armed forces will need to 
adapt to a reduced budget while maintaining the capability to adapt to an increasingly 
dynamic environment. Thus, the military will benefit from a capabilities-based automated 
information system designed to leverage technological opportunities in order to achieve 
dominance across the range of military operations. This “information superiority” will 
allow the Joint U.S. forces to achieve massed effects by concentrating combat power at 
the decisive time and place with unparalleled precision. This vision is, “built on the 
premise that modem and emerging technologies — particularly information-specific 
advances — will have a tremendous impact on the use of military forces” (General John M. 
Shalikashvili, Chairman, Joint Chiefs of Staff). 

A key component of this vision is the concept of fused “all-source” intelligence. 
Real-time information gathered from all levels will be assembled into a fuller 
understanding of the situations at hand and disseminated to requisite forces. Putting a 
fused “full picture” into front line units calls for enhanced sensors and better weapons to 
extend the range of offensive actions. Under contract by the U.S. Technology 
Reinvestment Program, FLIR Systems, Inc. is part of a multi-company effort to develop a 
real-time “fused” image from a normal nighttime scene and infrared imagery (Aviation 
Week and Space Technology, April, 1997). The goal of this program is to develop and 
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demonstrate a system that would allow a pilot to recognize and maintain visual contact 
with the runway at night, even in heavy precipitation and fog. Improved warfighting 
technologies such as this could be extended to allow U.S. forces to engage in warfare 
operations seamlessly in day and night, good weather or bad, thus extending our range of 
offensive capabilities. The goal of enhanced vision, particularly at night, is to allow U.S. 
forces to fly, drive, steam, and fight anywhere, at anytime. {Aviation Week and Space 
Technology , April, 1997) 

The challenge of fusing intensified light (IL) and infrared (IR) nighttime imagery 
into an enhanced image is not unique to FLIR Systems. Several efforts are underway 
proposing various approaches to sensor fusion. Massachusetts Institute of Technology’ 
Lincoln Laboratory (MTTLL), Texas Instruments Corporation (TI), and the Naval 
Research Laboratory (NRL) in conjunction with the Naval Postgraduate School (NPS) 
have their own methods of fusing these nighttime images. These techniques may differ on 
the algorithm approach, but they all have the same objective: improving the image quality 
for the observer. Several behavioral studies (Essock, McCarley, Sinai, and Krebs, 1996; 
Sampson, Krebs, Scribner, and Essock, 1996; Steele and Perconti, 1997) and image 
quality studies (Scribner, Satyshur, Kruer, 1993; Waxman, Savoye, Fay, Aguilar, Gove, 
Carrick, and Racamato, 1996) have tried to quantify the benefits of sensor fusion, but the 
results were inconsistent. The purpose of this thesis is to model human performance using 
two mathematical models, a matched filter and a contrast based image quality metric, both 
of which are based on the human visual system. The advantages of the model approach 
are twofold. First, it quantifies the degree of “enhancement” achieved by a fusion process. 
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thus allowing for direct comparisons of the various sensor fusion techniques. The second 
advantage is the ability to predict human visual performance under a variety of 
environmental and terrain conditions. 
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H. BACKGROUND 



A. FUSED COLOR ENHANCEMENT 

Intensified-light and long-wave infrared sensors are the primary sensors for military 
night operations. These sensors provide a unique view of the scene being observed due to 
the differing frequency bands of operation. Scribner, Satyshur, and Rruer (1993) 
proposed that combining images from two separate sensors into a single “enhanced” 
image significantly improves user’s target detection and situational awareness. It is 
hypothesized that the probability of missing a target is much greater for a single band 
sensor than for the composite fused band. In addition, combining multiple bands into a 
single fused color scene should enhance the contrast between the foreground and 
background, e.g., separation of vegetation (Scribner, Satyshur, Shuler, and Kruer, 1996). 

The hypothesized advantages of pseudo-color enhanced images are based on the 
human vision system’s (HVS) ability to discriminate various frequency bands within visible 
light. Color perception in the HVS evolved primarily to increase survival by better 
facilitating detection and discrimination. This is achieved by the photosensitive pigments 
in the cone visual receptors within the human eye. Normal human vision is trichromatic, 
which allows the HVS to make use of three “color bands” when observing a daylight 
scene (Sekuler and Blake, 1990). Certain colors, such as red, have instinctive 
psychological impact and tends to draw attention, enhancing detection and discrimination 
of possible dangers. Other animals, such as snakes of the subfamily Crotalinae (e.g., pit- 
vipers, rattlesnakes, copperheads, and water moccasins) and the Boidae family (e.g., 
pythons), also make use of more than one “color” band to enhance their survival (Hartline 
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and Newman, 1982). These snakes have evolved infrared-sensitive pit organs which can 
sense with deadly accuracy a small , warm object, such as a mouse, at a range of half a 
meter without visual information. Thus, their ability to combine the infrared signals from 
the pit organs with visual signals from the eyes further enhances detection and 
discrimination. 

If the HVS were monochromatic, then scenes would look much like an image 
displayed on a monochrome CRT. Digitized monochrome images physically represent 
each pixel as one of 256 different levels of brightness (grey -levels). However, the HVS 
can perceptually distinguish only about 30 grey levels on a CRT with images collected 
under ideal lighting conditions. For images acquired under very dim light, or some other 
mode such as image-intensified devices or long-wave infrared sensors, the grey-scale 
depth of the image is even more limited. Therefore, a pseudo-color enhanced digital 
image would allow for better classification of various regions or points of specific 
information within the image. It would also aid the HVS in distinguishing subtle 
variations which are imperceptible in the single-band monochrome displays (Russ, 1995). 

It is important to understand the distinction between a color scene observed 
through the human eye and a processed pseudo-color scene. As previously mentioned, in 
a naturally lit environment, various colors have certain psychological impact that has 
evolved over time. In order to ensure that these color queues appeared the same for a 
wide range of environs throughout the day, the HVS evolved the ability to distinguish 
these colors under varying natural lighting conditions (Sekuler and Blake, 1990). For 
example, a color such as red tends to appear the same shade of red whether indoors or 
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out, while in bright afternoon sunlight or in a late afternoon sunset. The HVS’s ability to 
adapt to small variations in the spectral distribution of natural light and provide consistent 
physiological queues is termed color constancy (Sekuler and Blake, 1990). Algorithms 
exist which allow a television camera to exhibit something similar to color constancy. 
However, because the intensified light images are taken at such low levels of illumination, 
all colors appear gray. In the case of the infrared images, the infrared band is decidedly 
outside the range of natural light and cannot provide color queues which correlate with the 
visible bands. As a result, the intuitively “correct” color information of the objects within 
any of these scenes is lost. The objective of pseudo-color processing emphasizes color 
contrasting rather than reproducing the intuitive colors of the scene, as demonstrated by 
the pseudo-color process developed by NRL. However, with a priori information as to 
what these intuitive colors should be, it is possible to provide a more intuitive pseudo- 
colored scene, as demonstrated by MIT’s pseudo-color process. 
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Figure 1 . Examples of Color Fusion processing. On the left is NRL’s fusion process; 
on the right is MIT’s fusion process using a piori knowledge of scene content. 
(Courtesy of the U.S. Army Night Vision and Electronic Sensors Directorate). 
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B. MATCHED FILTER PERFORMANCE ESTIMATION 



Statistical signal processing has been widely used in communications and other 
areas requiring discrimination of a signal from noise. Image detection is the natural 
extension from one-dimensional vector sampling to a two-dimensional signal, such as a 
digital image. One image detection technique employs the use of a spatial “matched” filter 
to determine the presence or absence of an object within an image. A matched filter is a 
two-dimensional (2-D) array which has been optimized to maximize the signal-to-noise 
ratio and provide a measure of the spatial correlation between the input image and the 
reference image (Pratt, 1991). The resulting filters are “tuned” to negate the effects of the 
background (noise) of the image in which the filter is to be used and enhance the detection 
of the target. Scribner et al. (1993) used a matched filter on long-wave infrared (9.0 to 
1 1.6 pm), medium-wave infrared (4.5 to 5.5 pm), and short-wave infrared (2.0 to 2.6 pm) 
sensors, as well as on a fused single image of these bands. In this approach, spatial-only 
and spatial-spectral matched filters were derived for the three infrared images and the 
fused composite image respectively. The intent of these matched filters was to simulate 
the detection ability and sensitivity of the HVS. The single-band filters were derived using 
the smoothed power spectrum of the background and the proposed target template. The 
3-D spatio-spectral (color) filter was derived by considering the target and the background 
as a 3-D space, with the third dimension being the spectral values at each pixel. The 
respective filter is then shifted to several locations within the image; the values are 
multiplied by the pixels that are overlaid; and the summed value is stored for each 
position, showing where regions identical or similar to the target are located. These values 
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are then compared to a second set of calculated totals produced by the same procedure, 
but with the target inserted at corresponding locations. By comparing the signal-plus- 
noise values to the noise values for a given threshold value, false alarm and target 
detection probabilities can be calculated and displayed in the form of an empirical receiver- 
operator curve (ROC) (see Figure 2). 

i . ■ " iiiiiwii 

§!!!$ 7 ’■ ' ’ ' ’ ' ‘ ; i ‘ v ! ; 7/ r " 1 v: - v v: v vv: ■ !v : ‘ ■ v: ■ v '||||| 

1111 - ; ‘ -111 

Ill&il:- ' 

Kil’ wp 

-illl 

l«II ! III: 

mm-: 

mm : wM 

l||| ■ -111 

ll:II : 18§ 

-|g§| 

M - ; • i 

I!!|;; ■ i illll 

I l:;0L , , A JM 

B ©I B-a ©3 B4 ©5 &S ©7 3© t 

Figure 2. Example of an empirically derived receiver-operator curve 
(ROC) for the monochrome fused “rectangle” scene using a 2-D global 
matched filter. 

The background of an image can be viewed two ways. One way is to use the 
entire image (less the target) to match the target filter, resulting in a globally matched 
filter. Scribner et al. (1993) used this approach on overhead aerial images. Another 
approach is to use only those areas within the image in which the target sensibly will be 
located. For example, an image taken from an aircraft at low altitude often contains a 
horizon separating the sky from land. If the target to be detected is a truck then the sky 
portion of the image may be removed from consideration. Thus, the background of the 
land area is used to match the target filter, resulting in a locally matched filter. Since all of 
the images used for the human factors experiment (Sampson, 1996) were taken from an 
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aircraft at low altitude, the local matched filter should perform better than a global 
matched filter because the targets are all objects found on the ground. Thus, a large 
difference should exist between the performance predictions of the local and global 
matched filters. 

When applied to aerial images of natural scenery, this matched filter approach 
resulted in as much as a full order of magnitude increase in target detection rate for the 
“composite” (color fused) images (Scribner et al., 1993). However, the validity of these 
results hinges on the accuracy with which the matched filter models the sensitivity of the 
HVS. The primary limitation of the matched filter approach is that the output is the 
degree of correlation between the “energy” of the input and reference images rather than 
the correlation between the spatial structure. Thus, any area having the same relative 
energy would be seen as the target, regardless of the spatial shape. This type of matched 
filter generally provides poor discrimination between objects of different shapes. 

However, it will locate regions of similar size and energy (Pratt, 1991). Also, Scribner et 
al. (1993) used the preprocessing technique of normalization of the background image to 
standardize the images and remove the variations in lighting conditions since the various 
images were taken under different conditions. This processing is similar to the removal of 
the DC component within the image. Removing this DC component prior to filtering with 
a matched filter should extend the dynamic range of values achieved by the matched filter 
(Russ, 1995). 

A filtering process similar to the matched filter process is referred to as template 
matching. In this process, the target itself is used as the filter or template. The application 
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of this filter is carried out the same way as for the matched filter. Like the matched filter, 
the target template is then shifted to several locations within the image, the values 
multiplied by the pixels that are overlaid, and the summed value stored for each position, 
showing where regions identical or similar to the target are located. As the target 
template passes over a target, it will output a maximum value, whereas other areas 
without the target will result in relatively low output values. This target template is 
extremely specific, producing a maximum value only when an exact match in shape and 
coloring has been found. Therefore, template matching represents one extreme of machine 
vision since the slightest deviation from the template will be reflected by an inordinately 
lower value relative to the maximum. However, this process could provide a basis for 
comparing the performance evaluations produced by the matched filter process since 
template matching reflects the most specific target search of the image being filtered. As a 
means of modeling the HVS, this template matching process has numerous short-comings. 
The theory of a matched filter is theoretically different in that it is optimized to enhance 
“target-like” detections while reducing the effects of noise by discriminating on the basis 
of relative “energy”. However, the results may still closely follow the trends of an 
ordinary template matching process. Thus, when comparing the results of the matched 
filter with the results of template matching, we would expect to see significant differences 
in performance predictions across the combinations of scenes and sensors. 
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c. 



HUMAN FACTORS STUDY TO INVESTIGATE FUSED COLOR 



IMAGES 

Based on the superiority of fusion and color hypothesized by the matched filter 
approach (Scribner et al., 1993), a human factors experiment (Sampson, 1996) at the 
Naval Postgraduate School investigated a priori belief that the results from a visual search 
paradigm would favor a color-fused image over an infrared or intensified light image 
alone. A color-fused, monochrome-fused, LWIR, or intensified light image was displayed 
(with or without a target) for 600 milliseconds and then removed. Subjects then rapidly 
responded, indicating whether there was a target in the scene or not, with reaction time 
and accuracy as the dependent measures. The experiment failed to provide enough 
evidence to show lower mean reaction times for color-fused or monochrome-fused images 
when compared to the those for the individual sensor bands (Sampson, 1996). 

The non-significant results could be explained by the matched filter technique 
which is highly dependent on both the specified target colors and the background 
statistics, which vary immensely from scene to scene. This is especially true for images 
acquired in low light conditions where statistical fluctuations become important (Russ, 
1995). Thus, the application of the same matched filter process to the fused images and 
individual bands used in the human factors testing are bound to vary greatly. In light of 
the specific nature of the matched filter approach, the use of image quality metrics based 
upon models of the HVS may be a more appropriate means of predicting color-fused 
image performance. 
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D. IMAGE QUALITY METRICS (IQM’S) 



Image quality refers to the detail provided by a visual image, which directly 
correlates to the depth of information that can be extracted from that image. A low- 
quality image may provide basic situational awareness as to the type of scene being 
observed. Examples of low-quality images are those whose depth of detail allow an 
observer to detect such objects as railroad yards or a ship in a harbor. Higher-quality 
images would provide increased depth of information, such as being able to identify 
vehicle types parked at the railroad yard or classification of the ship type and ongoing 
activities in the harbor (Nill and Bouzas, 1991). Thus, IQM’s are much harder to define 
and measure since “quality” compensates for human perception. One such IQM is the 
Contrast Sensitivity Function (CSF). The CSF represents what an individual can see 
across different spatial frequencies. For example, the furthest point (high spatial 
frequency) represents visual acuity. A CSF is obtained by the visual perceptions of several 
subjects observing a test “grating” on a specifically designed and calibrated television 
screen while the contrast was varied by experimenters. Contrast was increased until the 
test gratings were just visible to each subject and the contrast threshold recorded. This 
procedure was repeated for test “gratings” of various spatial frequencies, and the results 
averaged (Sekuler and Blake, 1990). Figure 3 shows the resulting contrast threshold 
curve separating the region corresponding to contrast levels below the threshold curve (a 
decrease in contrast), and the pattern not being visible (region above the threshold curve), 
and the region corresponding to contrast levels above the threshold curve (an increase in 
contrast), and the pattern becoming visible (region below the threshold curve). 
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Figure 3. A contrast sensitivity function for an adult human. The upper 
horizontal axis is scaled in units specifying the number of pairs of light 
and dark bars of the grating falling within one degree of visual angle on 
the retina. (Sekuler and Blake, 1990) 

A characteristic difference between the CSF and a physical transfer function of a lens is 
that the CSF drops at lower frequencies, implying that the HVS is more sensitive to 
intermediate frequencies. Therefore, the contrasting cues available to the HVS provided 
by a digitized image may be quantitatively measured and compared directly to the 
performance predicted by the matched filter process and to the results of the human 
factors testing. 

Due to the limitations of the sensing and display media, any image displayed on a 
CRT is subject to a spatial degradation of the observer’s CSF. Knowledge of the CSF’s 
shape may also allow compensation for the display degradation by weighting the 
intermediate frequencies of a digitized image. A similar approach is done to correct 
midrange sensitivity degradation in the HVS. Low-vision patients utilize visual aids that 
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boost midrange spatial frequencies. Of several previously developed models and 
approximations of the CSF, the generalized model of human contrast sensitivity developed 
by Pelli, Rubin, and Legge (1986, 1990) implements a parabolic fit of the CSF. This non- 
linear fit models the input-output representation of the HVS at moderate- to low-level 
illumination. Thus, weighting the digitized single band images and the color fused images 
and comparing the resulting CSF IQM’s enables us to develop techniques to quantitatively 
evaluate the performance of the various color fusion methods, as well as to quantify and 
scale the advantages gained by multi-spectral color fusion. 

E. SENSITIVITY ( d ' ) IN SEARCH DETECTION THEORY 

Whether a target detection is accomplished through the HVS or through electronic 
means, such as the matched filter, the theory of signal detection requires recognizing a 
signal from a background of noise. Thus, accomplishing signal detection requires 
determining the rate at which the signal plus random noise is correctly detected, as well as 
determining the rate at which the random noise is incorrectly determined to be a signal 
plus noise (Macmillan and Creelman, 1991). These rates are the probability of detection 
or “hit” rate (Ph), and the probability of a false alarm (Pfa) respectively. These probability 
measures allow the calculation of the standard sensitivity of Search Detection Theory, d- 
prime ( d') for an observer viewing the corresponding image (Macmillan and Creelman, 
1991). This sensitivity is a measure of the proficiency in which the signal plus noise is 
discriminated from the noise and is the difference, in units of standard deviations, between 
the means of the respective distributions (Macmillan and Creelman, 1991). Thus, when a 
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strong signal is applied to a Gaussian noise background, the resulting difference between 
the means of the signal plus noise distribution and the noise distribution becomes large. 
For weaker target signals, the difference between the two distributions decreases until the 
signal is so weak that the distributions are virtually the same, resulting in significant 
overlap and great difficulty in signal discrimination (Gescheider, 1985). 



j- = 3 



./• -- 2 









Figure 4. Three representations of paired “Noise” and “Signal+Noise” distributions for 
d'= 3, 2, and 1. This illustrates the measurement of d' as well as the trend from a well 
discriminated “strong” signal (d' = 3) to a relatively “weak” signal (d'= 1) (Schiffman, 
1990). 

This sensitivity is defined in terms of the inverse of the normal distribution, Z(-) 
(Macmillan and Creelman, 1991): 

d'= Z{Ph)-Z(Pfa ) 

In order to avoid infinite results, such as in the case of a perfect score of Ph=1.0 and 
Pfa=0.0, experimenters have accepted an upper probability limit of 0.99 and a lower 
probability limit of 0.01. Thus, a perfect score would result in an upper bound on d' of 
4.65, while a moderate performance implies a d' of 1 .0 and a “random” performance 
having a d' equal to zero (Macmillan and Creelman, 1991). 

Calculation of sensitivity from the results of the human factors experiment 
(Sampson, 1996) is a straightforward proportion of “hits” and “false alarms” to the 
number of trials presented for each image. Figure 5 shows four scenes from one of the 
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three images used containing a tower on a grass field background with the target, a 
satellite dish, in the three positions presented. The fourth picture shows the same scene 
less the target, which was presented along with the other three randomly as a distracter. 







Figure 5. Examples of the four “target positions” presented to subjects 
of the human factors experiment (Sampson, 1996). This is an example of 
the intensified light sensor (Courtesy of the U.S. Army Night Vision and 
Electronic Sensors Directorate). 

A correct response is scored as a hit if the observer responds that a target was present, 
and one of the first three scenes containing the target has just been presented. An 
incorrect response is scored if the observer responds that a target is present when, in fact, 
scene four has just been shown. This is counted as a false alarm. 

In the case of the matched filter, the signal to noise and noise values for several 
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points throughout the same images used in the human factors experiment will be 
computed. The hit and false alarm rates will then be calculated according to local and 
global thresholds developed from each of the three target positions from each image. At 
each target position, the signal plus noise (SNt) and noise (Nt) values are computed. 

These SNt and Nt values are then used as global thresholds to determine the hit and false 
alarm rates. Any SN value from the several previously calculated and stored values which 
is greater than Nt will be viewed as a “hit”, while any N value from the several previously 
calculated and stored values which is greater than SNt will be viewed as a “false alarm”. 
For those SN and N pairs of the previously stored values which fail to exceed the global 
“hit” threshold, Nt, an additional local threshold based on the relative magnitude between 
the SNt and the Nt, is applied. According to search theory, these values will differ in 
relative magnitude such that the SNt value at the target position will be greater than the Nt 
value. This relative magnitude is related to how well the matched filter can distinguish the 
target signal above the local noise present. Thus, from the values calculated and stored 
previously, any SN and N pairs with a relative magnitude equal to or greater than the 
relative magnitude between SNt and Nt is viewed as distinguishing the target from the 
background and is counted as a hit. Thus, calculating Ph and Pfa becomes a 
straightforward proportion of “hits” and “false alarms” to the number of points evaluated 
within each image. Since sensitivity can be determined for the HVS as well as for the 
matched filter, it will allow a direct comparison of the HVS to the matched filter. 
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F. 



RESPONSE BIAS (P) IN SEARCH DETECTION THEORY 



In search detection theory, a constant d’ value can be obtained by many 
combinations of Ph and Pfa. A plot of these Ph and Pfa values (for a constant d' ) results 
in a ROC plot. Where observers actually fall on this ROC plot is a function of their 
response bias. This is the tendency for an observer to favor one response over the other 
(Macmillan and Creelman, 1991) can be varied by the addition of rewards or penalties for 
correct and incorrect responses. One measure of response bias, P, is a likelihood criterion 
based on the probability density function (pdf) of the normal distribution (Gescheider, 
1985). 

f3 = , where is the pdf of the Normal distribution. 

<P(Pfa) 

The value of P corresponds to the point on the ROC plot tangent to a line of slope 
P. Thus, P equal to one corresponds to no bias and represents the point on the ROC plot 
that intersects the minor axis of the plot (see Figure 6). The minor axis travels in a 
straight line from the upper right comer diagonally down to the lower left comer. A value 
of P greater than one represents a response bias on the lower half of the ROC plot, while a 
P less than one would be found on the upper half of the ROC plot. 
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Figure 6. This illustrates the features depicted on a ROC 
plot. On the major axis is the observer’s sensitivity ( d ' ). 

On the minor axis is the observer’s response bias ((B) 

(Schiffman, 1990). 

Since |3 is dependent upon the previously calculated values of Ph and Pfa, it will also be 
possible to compare the response bias of the HVS to that of the matched filter. 



G. HYPOTHESES 

The purpose of this thesis is to investigate the validity of using matched filters or 
psychophysically based image quality metric in evaluating various multi-spectral color 
fusing algorithms. If the matched filters or psychophysically based image quality metric do 
not model the HVS then we would expect to see large differences between the sensitivities 
produced by the models and the sensitivities from the human subjects. Additionally, if the 
matched filter concept is a viable method of modeling the HVS, then there should be a 
large difference between the Globally matched filter and the Locally matched filter 
sensitivities. 
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The Template matching filter was included in this evaluation since it is a standard 
image-processing search paradigm which makes no attempt to model the HVS. If the 
matched filters outputs correlate highly with the results of the Template matching filter 
rather than the results of the human data then modeling the HVS with the matched filters 
would be questionable. Thus the hypotheses developed to evaluate whether the 
mathematical models simulate the results of the humans are listed below. 

♦ There will be no differences between color-fused, monochrome-fused, infrared, and 
intensified light image performance predictions by matched filter evaluation and the results 
of human factors testing applied directly to the same images. If rejected this would 
support that the matched filter process is not an accurate method for predicting the 
performance of the HVS. 

♦ There will be no differences between the performance predictions of the Local and Global 
matched filters for the same images and preprocessing. This should not be true, as the 
local filter should perform better; however, if no difference is found, then this tends to 
suggest that the matched filter concept of “tuning” the filter to negate the effects of the 
background may not have the desired effect. 

♦ The results of the matched filter process on an image will show the same trends as that of 
an ordinary template matching process. 

♦ There will be no differences between the color-fused image performance predictions by 
the contrast-based IQM and the results of human factors testing applied directly to the 
same images. If rejected, this would support that the contrast-based IQM is not an 
accurate method for predicting the performance of the HVS. 
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ID. MODEL 



A. THEORETICAL DEVELOPMENT OF A MATCHED FILTER 

A discrete matched filter for object detection can be developed using a spectral 
formulation that results in a matrix equation that maximizes the signal-to-noise ratio. The 
algorithm used by Scribner et al. (1993) develops the two-dimensional matched filter 
along the following theoretical process. Given than the observed image (F jn ) may consist 
of background noise (n ) alone or a deterministic signal plus background noise (s +n) , 
we have the following: 

F in = s + n, or F in =n. 

Thus, if h 2 were the 2-D matched filter optimized to maximize the signal to noise-power 
ratio, then the resulting output ( F out ) of the matched filter may be expressed as the 
convolution (0) of h 2 with F m . 

F -h ®F 

1 out rt 2 KyI in' 

The signal to noise-power ratio is defined simply as, 

S 2 _ spectral signal 
N 2 spectral noise power ’ 

where the 2-D spectral signal ( S 2 ) is defined in terms of the signal in the absence of noise. 
Since the dimensions of the target are usually smaller than the dimensions of the 
background, the target is padded with zeros to the dimensions of the background while 
keeping the target centered in the middle. This padded target is then converted from the 
spatial domain to the spectral domain through a 2-D fast fourier transform , . 

S = ffi 2 ( 5 ). 
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An illustration to help visualize the conversion of a 2-D image from the spatial domain to 
the spectral domain can be seen in Figure 7, which first shows the spatial representation of 
two points on the horizontal axis of the spectral domain. These two points are low- 
frequency points due to their close proximity to the center. The corresponding spatial 
domain representation is a vertical white band with two dark bands representing a sine- 
wave corresponding to its low-frequency placement. In the second frame, two more 
points are added to the vertical axis at the same low-frequency, which produces the 
equivalent sine-wave “bands,” but in the horizontal orientation. As points of higher 
frequencies are added to the spectral domain plot, a more and more complex “pattern” 
emerges for the spatial “image.” 
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Figure 7. A figure showing the relationship between the 2-D spatial domain image of 
Einstein and the image’s spectral domain representation. The first four frames are shown 
at a much lower scale than those of the last four frames. This was done so that the 
individual points could be distinguishable. The numbers below the spectral domain plots 
represent the number of components represented (first four frames) or the percentage of 
all the points represented. (De Valois, R. L., and De Valois, K. K, 1988) 



Carrying this concept a step further, the spectral “power” of an image is the square of the 
image’s spectral domain representation. The 2-D noise power (V 2 ) is defined in terms of 
background noise only and is the spectral power of the noise. Producing the background 
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noise spectral power is accomplished by converting the noise from the spatial domain into 
the spectral domain and squaring. 



Noise power (vV 2 ) = . 

Next, the noise power is high-pass filtered in the spatial domain using an fft shifted two- 
dimensional Hanning window. This requires 2-D inverse fast fourier transforming 
(ijft 20) the spectral noise power back to the spatial domain and carrying out an element- 
by-element multiplication of the shifted Hanning window with the spatial noise power. 
Once this filtering is accomplished, the result is transformed back to the spectral domain. 
This high-pass filtering “smoothes” the background “energy” by attenuating the 
background “energy” contained in the lower frequencies. Thus, the background noise 
used to optimize the filter consists of an average “energy” image with only the “relative 
energy” contrast of the target on background preserved. Thus, substituting the smoothed 
noise power ( N s ) into the signal to noise-power ratio and transforming back to the spatial 
domain results in a solution for the matched filter. 



K = ijft 2 



r conj(S 2 f 

N 7 J 



The conjugate on the signal “inverts” the filter in the same way a transpose 
operation would if done in respect to the minor axis of the matrix. This conjugate is 
carried out since the filtering process is done in such a way that the corresponding 
coefficients are 180 degrees out of phase with respect to the minor axis. 

With respect to the physical size of the matched filter, a conscious attempt to 
create a filter larger than the original target was based on the importance of evaluating 
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some of the surrounding background noise both around the target and within the area in 
which the target is specifically defined. The amount that the filter was expanded beyond 
the dimensions of the actual target depended upon the size of the target. Larger targets 
should be expanded in the same proportions that a smaller one would. Thus, the matched 
filter developed was expanded in the vertical and horizontal directions by two times the 
square-root of the vertical and horizontal dimension of the target respectively. For 
example, in the case of the cylindrical storage tank target having dimensions of 23 pixels in 
height by 89 pixels in width (23x89), the filter developed would have dimensions of 
(33x107). This procedure develops the 2-D spatial filters which are used on the single- 
band or fused monochrome images. 

For color-fused images, three-dimensional (3-D) “color” matched filter 
coefficients are produced, in addition to the 2-D filters, for each color band by performing 
a three dimensional fft , denoted fft3 () , on the 2-D targets and backgrounds. For 
example, if the image were to be fused from an intensified light image and an infrared 
image, in addition to the creation of the two spatial 2-D filters, two spatial-spectral 3-D 
filters are also produced for the JR and the IL. Creating the 3-D matched filter 
coefficients is accomplished using the same theoretical procedure explained above; 
however, it is carried out on the two bands combined into a 3-D structure. This third 
dimension is developed by “stacking” the results of the fftl of the individual band targets 
and backgrounds into a three dimensional matrix and performing a third fft with respect 
to the z-axis. A spectral domain 3-D matched filter (H 3 ) developed in this manner is 
expressed, 
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Hi(k) = c 0 ^^J exp(-ikr 0 ), 

N 3 (k) 

where S 3 is the 3-D signal representation ink = ^k x k y k f ], N 3 is the 3-D spectral noise 
power (Satysher, Scribner, and Kruer, 1997). Thus, the spatial filter is, 

which involves carrying out an iffi with respect to the z-axis followed by a ifft'l resulting 
in the spectral-spatial matched filters. All of these filters are then stored automatically into 
a file with a filename consisting of the image name, target name, the processing options 
specified, and an extension of “.coef.” The MATLAB code generating the global and 
local matched filters is listed in Appendix E. 



B. THEORETICAL DEVELOPMENT OF THE CONTRAST-BASED IMAGE 
QUALITY METRIC 

The contrast sensitivity function (CSF) represents the transform function between 
the image being viewed and the spatial frequency response of the HVS. Based upon the 
averaged results of several contrast threshold experiments, parameter estimates of the 
actual CSF have been obtained. Various mathematical models have been proposed based 
on the assumption that this CSF is a smooth curve. The generalized model of human 
contrast sensitivity developed by Pelli, Rubin, and Legge proposed a parabolic fit to this 
CSF. Pelli et al. (1990) offered this simple non-linear parabolic fit as a satisfactorily 
accurate, easily implemented, and fast model. 
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A Visual C++ program developed by Dr. Sanjoy Das implements the general Pelli 
model to compensate for the spatial display degradation of a CRT by weighting the 
intermediate frequencies of a digitized image. This is accomplished by transforming an 
image from the spatial domain to the spectral domain by means of the fft2, and then 
radially weighting those frequencies associated with the experimentally estimated CSF 
according to Pelli’ s non-linear parabolic model. This reweighted image is then 
transformed back into the spatial domain by means of the ifft2. The resulting image is 
now weighted in accordance with the proposed Pelli CSF model. This program performs 
this reweighting on single-band and monochrome images as is. All pseudo-colored images 
must first be split into their RGB components and each color band reweighted 
individually. The Visual C++ code developed by Dr. Sanjoy Das to accomplish the above 
is shown in Appendices L and M. 



C. SETUP OF PLANNED COMPARISONS BASED UPON THE 
HYPOTHESES 

Instead of analyzing the data to see if there is one or more overall experimental 
effects, the planned comparisons technique will be used to answer a number of individual 
questions posed at the outset of the experiment. These proposed hypotheses around 
which this experiment was designed are examples of specific questions to be answered 
separately from the experimental results. The planned comparisons sensitivity “model” 
constructed to evaluate these proposed hypotheses have the form: A x B x C x D. The 
four different filters evaluated in this experiment are represented in group “A”: the global 
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matched filter (G), the local matched filter (L), the template matching filter (T), and the 
“Human” filters (H). The “Human” filters consists of the five subjects who participated in 
the human factors experiment (Sampson, 1996). The different image scenes used in this 
experiment are represented in group “B”: a scene containing a “rectangular” target or 
building (“ret”), a scene containing a “cylindrical storage tank” (“tnk”), and a scene 
containing an airfield “tower” (“twr”). The four different sensor “classes” used for each of 
the scenes in this experiment are represented in group “C: infrared (IR), intensified light 
(EL), pseudo-color fused (FI), and monochrome fused (F2). Lastly, the three different 
target positions used for each scene/sensor combination are represented in group “D: 
position “1” is the original target position within the scene; positions “2” and “3” were 
derived by digitally moving the target to two other locations within the corresponding 
scene. 



D. MODELING A NORMAL DISTRIBUTION FOR CENSORED 
REGRESSION 

The human factors data measuring the amount of time to located the target or to 
determine its absence within an image can be modeled with a Normal distribution with a 
mean equal to 706.3 psecs and a standard deviation of 128.7 (ks=0.1402, p=0.0712). 
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Mean Reaction Times and Fitted N{706.3,128.7) 
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Figure 8. The mean reaction times from the human factors experiment (Sampson, 1996) 
fitted with a N(706.3, 128.7). 

The censored normal function can be used in cases in which the dependent variable is 
censored to a maximum value. Censoring of this type is known as censoring from 
“above.” This type of data requires a mixed distribution with the continuous Normal 
portion existing as usual for values less than the “censor” value. At the “censor” value, 
the Normal distribution “jumps” to a discrete probability representing the Normal 
probabilities above the “censor” value. This kind of distribution exists for the sensitivity 
data calculated from the human factors experiment (Sampson, 1996) and will be applied to 
the sensitivities of the mathematical models being evaluated. For the purposes of this 
experiment, a maximum sensitivity of 4.6527 was imposed. 

This censored regression technique applies because ordinary least squares 
regression becomes inconsistent as the percentage of censored values within a dataset 
increases. Unfortunately, there are no hard and fast rules dictating what percentage of the 
dataset is allowed to be censored without affecting the ordinary least squares (OLS) 
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estimates. It is generally agreed that if less than ten percent of the dataset is censored, 
then the effects of censoring on the OLS is minimal. It is also generally agreed that 
somewhere around forty percent of the dataset being censored will most likely result in 
severe effects. The safest route is to address the censoring issue directly by producing the 
maximum likelihood estimates for the coefficients of the censored dependent variable and 
comparing it to those estimated by OLS and interpreting the severity. 

The regression coefficients for a censored Normal distribution can be obtained 
with the log-likelihood estimation providing the maximum likelihood estimators for the 
coefficients of a censored regression. (Greene, 1997). 
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The <!>(•) notation represents the normal CDF and “a” represents the censor value. The 
above equation is a sum of two parts. The first part sums the classical regression for the 
non-limit observations, followed by a sum of the relevant probabilities for the “censored” 

observations. Using Olsen’s (1978) reparameterization of y = /?/<r and 0 - \/a, the 
model simplifies tremendously, allowing for straightforward calculation of the Hessian. 
The estimation then lends itself to Newton’s method. 
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results in the elements required for Vf ( p ) and V 2 / ( p ) , where, 
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The elements required for V/ ( p ) are, 
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The elements required for V / (p) are 
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Once the maximizing parameters ( p ) have been determined, the coefficients and standard 

deviation can be recovered since /? = y /6 and a - \/9. In addition, an estimated 
asymptotic covariance matrix is determined using a J matrix and the Hessian for p with, 



J = 



where / is an identity matrix and 0' is a vector of zeros. 
The resulting covariance matrix is then equal to, 

COV = J[-V 2 f(p)]'j'. 
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IV. METHODS 



A. MATCHED FILTER PROGRAM DEVELOPMENT 

The experiment constructed for this thesis was to use a matched filter program as 
well as an IQM program to quantify the expected performance of various infrared, 
intensified light, fused monochrome, and pseudo-color fused images in order to compare 
them to the results of human target detection performances. 

The matched filter program was based upon the approach used by Scribner et al. 
(1993) to evaluate the images used in the human factors experiment (Sampson, 1996). In 
order to remain consistent with the human factors experiment, the matched filter program 
used the same targets contained within the human factors images rather than the synthetic 
targets used by Scribner et al. (1993). Also, the images were not aerial photographs of air 
fields and other similar areas of interest taken from a relatively high altitude. Sampson’s 
images were taken at low altitude and contain a horizon separating earth and sky. Thus, 
the program included an option to develop a matched filter based only on the area in 
which the target could sensibly exist, resulting in an option to create a global or local 
matched filter based upon the background of interest. This was accomplished by allowing 
specification of a rectangular area (termed the specified field) by inputting the coordinates 
of the upper-left (Xmin, Ymin) and lower-right (Xmax,Ymax) comers in which the 
target’s center-of-mass can be placed. A third filter option, evaluation by way of template 
matching, was also developed for comparison to the matched filter evaluations. 

The MATLAB 5.0 program code for the matched filter appear in Appendices A 
through J and is divided into the major sub-sections of the program. Appendix A contains 
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the main m-file code, which coordinates calls to other m-file units. These other units 
accomplish: getting data, processing options, and carrying out any preprocessing (see 
Appendices B through D); deriving the specified 2-D and 3-D matched filter coefficients 
(see Appendices E and F); filtering the images with the developed filters (see Appendices 
G and H); and displaying the results (see Appendices I and J). 

B. BACKGROUND AND TARGET IMAGERY 

Three nighttime scenes were digitally imaged using an early prototype fusion 
sensor system developed by Texas Instruments and the Night Vision Electronic Sensor 
Directorate (Palmer, Ryan, Tinkler, and Creswick, 1993). These images were collected 
from a low-light visible image intensifier (.6-. 9pm) and a first generation forward-looking 
infrared (8- 12pm) mounted on a UH-1N helicopter. This system was designed to 
simultaneously record digitized IR and IL nighttime images. Images were collected during 
starlight (10° lux) to full moon (10' 1 lux) conditions. These IR and EL bands were then 
used to produce the monochrome fused and the pseudo-colored fused images resulting in 
a total of four sensor “classes” for each of the three nighttime scenes. The images and 
targets used for this experiment were identical to those used in human factors assessment 
of fused images on observers’ reaction time in target detection (Sampson, 1996). These 
images were all saved in the tagged index file format (TIFF) with image registration 
already accomplished. 

The first step in developing the matched filters was to separate the targets from 
the background. This was accomplished using Adobe Photoshop 3.0 on an Apple Power 
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Macintosh 6100/66 Power PC. The rectangle used to crop the target from the image was 
kept as small as possible. Additionally, in order to ensure that the matched filter 
developed from these targets would have a single center-point (correlating to the matched 
filter output), the vertical and horizontal dimensions of the rectangle were an odd number 
of pixels. Lastly, each target from a particular scene had to have the same target 
dimensions since the 3-D filters are developed from the respective targets of the bands 
being fused. 

Once the targets were cropped from each of the four image “classes” of a scene, 
each was enlarged, and any background around the target was “erased” by hand drawing a 
black outline around the target and painting everything not part of the target black 
(corresponding to a grey-level equal to zero). This resulted in the grey-level pixels of the 
target existing in a field of zeros, thus providing the pure target signal in the absence of 
noise. 




Figure 9. Example of the satellite dish target and the cylindrical tank 
target with the background noise removed. 

This was saved as the target in TEFF format, and then a target “template” was developed 
and saved. In the template, the background area around the target is white (corresponding 
to a grey-level equal to one), and where the target was located is all black (zeros). 
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Figure 10. Example of the templates used with the satellite dish target 

and the cylindrical tank target. 

This template is used to “cut out” the area in which the target is to be applied. Thus, since 
everywhere around the target is a value of one, an element level multiplication of a 
background segment with the template preserves the grey-levels multiplied by one. The 
area in which the target is to be placed is all zeros, which removes the area of the 
background corresponding to the shape of the target. This allows the target to be added 
to the background efficiently through matrix addition. 

C. FILTERING AN IMAGE WITH A MATCHED FILTER 

The background scene (area to be filtered) and specified field (area in which the 
target’s center of mass can exist) are directly related since the background scene is always 
physically larger than the specified field. The background scene can be as large as the 
original image itself, or as small as the dimensions of the filter being used. On the other 
hand, the specified field has a maximum size limited to the “central” portion of original 
image and can be as small as a single point. This “central” portion excludes the outer 
edges of the background. When the (Xmin,Ymin) and (Xmax,Ymax) coordinates of the 
specified field are input, the valid x-coordinate range is limited to those coordinates that 
are located greater than half the width of the filter being used from the left or right edges 
of the image. Similarly, the valid y-coordinate range is limited to those coordinates that 
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are greater than half the height of the filter being used from the top or bottom edges of the 
image. This is due to the specified field being the area in which the target’s center point 
can be located. By restricting the range limits in this manner, placing the filter center 
anywhere within the specified field results in the entire filter remaining on the background 
scene. This prevents any questions of validity regarding the filter’s output since no 
convolutions require padding with zeros. Thus, once the specified field has been input, the 
background scene to be filtered is then expanded outward from the coordinates of the 
specified region by half the width and height of the filter in the respective directions. 

When filtering a single color image, such as an infrared or a monochrome fused 
image, only the corresponding 2-D spatial filter is used. Optimally, the filter would be 
evaluated twice at every point within the specified field of the image—once to calculate the 
matched filter’s output value when applied to the background noise (N) only, and a 
second time to calculated the matched filter’s output when the target has been applied to 
that same location (signal-plus-background-noise (SN)). The scene in Figure 1 1 shows 
the fused monochrome “cylindrical tank” scene without the target present. 
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Figure 1 1 . The cylindrical tank scene on the left does not contain the target. On the 
right are the 2-D Global Matched Filter output values evaluated at every pixel within the 
scene (Courtesy of the U.S. Army Night Vision and Electronic Sensors Directorate). 



Evaluating the matched filter’s output for N only can be accomplished very 
efficiently by convoluting the entire background scene (without the target present) with 
the 2-D matched filter and considering only the “central” portion of the output. Thus by 
performing a single convolution, we have the results of evaluating that filter at every valid 
point within the background noise only. The plot in Figure 1 1 shows the 2-D global 
matched filter output values for each pixel of this “background noise” image. In this case, 
the filter is positively correlated, and the higher the filter output value, the more that area 
of background noise “matches” the target. 

In order to evaluate the filter value in the SN case, the filter must be convoluted 
with a background in which the target is present, as in the scene depicted in Figure 12. 

The plot in Figure 12 also shows the same 2-D global matched filter when convoluted 
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with the same background but the target present The large “spike” correlates to the pixel 
at (344,359), the location of the target’s center-of-mass. 




Figure 12. The cylindrical tank scene on the left with the target. On the right are the 2- 
D Global Matched Filter output values evaluated at every pixel within the scene. The 
“spike” correlates to the target’s location (Courtesy of the U.S. Army Night Vision and 
Electronic Sensors Directorate). 



This single SN value at (334,359), along with the single N value (from pixel (334,359) of 
the filter’s N output values), make up a single “evaluation” pair corresponding to the point 
(334,359). Consequently, evaluating the background noise with the target inserted at 
every point could require tens of thousands of iterations of inserting the target centered at 
the point being evaluated, convoluting this with the respective filter, storing the filter’s 
output value at that single point, and repeating for every pixel within the specified region. 
Since the images used for these evaluations are 456 pixels by 460 pixels (456x460) with 
various filters (largest being (65x69 ) pixels), attempting to evaluate such a large number 
of points would be extremely time-consuming. Thus, a sub-optimal approach was 
performed which allowed a step size to be specified for both the horizontal and vertical 
directions. The vertical and horizontal step size used for these evaluations roughly 
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correlated to one-fifth of the vertical and horizontal dimensions of the target being used. 
Figure 13 shows the suboptimal N and SN filter output values for the same scenes above, 
in which the specified region was limited to the grass field with a step size of 18 pixels 
horizontally and 4 pixels vertically (approximately one-fifth the target’s dimensions of 
(23x89)). 




Figure 13. Shown above are the 2-D global matched filter output values for a 
suboptimally sampled specified field corresponding to the grass field portion of the 
“cylindrical tank” scene. On the left are the results of evaluating the background noise 
only. On the right are the results of evaluating the signal+noise at the corresponding 
coordinates. 

In the case of evaluating the performance of more than one “color” band, the 
individual bands are evaluated as described above for both background noise and signal- 
plus-background-noise followed by the respective 3-D spatial-spectral filters. The 3-D 
filter output values for N are then summed into a single 3-D N output value (similarly for 
SN). All of the 2-D SN and N output values and the 3-D SN and N output values are 
then stored to the hard drive using the same filename convention described for saving the 
matched filter coefficients, except with a “.dat” extension. The MATLAB code developed 
to perform this filtering procedure is listed in Appendix G. 
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D. 



INTERPRETING MATCHED FILTER OUTPUT VALUES 



A matched filter is a spatial filter that provides a measure of the correlation 
between the background scene and the target (Pratt, 1991). Thus, the calculated matched 
filters can be thought of as acting much like a monotonic function, with the filter output 
values for N having a theoretical mean of zero due to optimizing the filter to reduce the 
effects of the background noise. In contrast, with the matched filter optimized for the 
signal to noise-power ratio, the filter output values for SN have a theoretical mean other 
than zero. As a result, the mean of the SN filter output distribution could end up being 
greater than (a positive correlation) or less than (a negative correlation) the mean of the N 
filter output distribution. Either way, a completely negative or a completely positive 
correlation results in “discriminating” the target from the background noise, which has 
relatively little correlation. In signal detection theory, the convention normally used to 
illustrate the relationship between the N and SN distributions graphically depicts the mean 
of the SN distribution to the right of the N distribution’s means. Thus, as the signal’s 
strength becomes weaker, the mean of the SN distribution shifts to the left until finally, 
there is no difference between the N and SN distributions (signal too weak to distinguish). 
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Magnitude of sensory observation (X ) 

Figure 14. Depicts the N and SN distributions as the signal’s strength 
becomes weaker until, finally, there is no difference between the N and 
SN distributions (signal too weak to distinguish) (Gescheider, 1985). 

In the same way, the increasing and decreasing distance between the means of the N and 

SN distributions as the target strength increases or decreases respectively is preserved by 

the matched filter, whether the correlation is positive or negative. The reason this 

negative correlation, or “inversion,” occurs has to do with matching the background of the 

target to a smoothed average “energy.” When the target is inserted into a background of 

lower or higher “energy” and filtered, the resulting contrast leads to either a negative or 

positive filter output value (Scribner, personal communication). However, in order to 

standardize the matched filter output results to conform to the accepted conventions of 

signal detection theory, those cases in which a negative correlation is determined to exist, 

all of the matched filter output values are multiplied by -1, resulting in the more 

conventional distribution relationship. This negative correlation exists when the mean of 

the matched filter SN output values is less than the mean of the matched filter’s N output 
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values. Figure 15 illustrates the histograms of the resulting 2-D Global matched filter N 
and SN output values for the “Cylindrical Tank” monochrome-fused image. 



Cylindrical Tank (F2) with Global Filter 




Figure 15. The estimated N and SN distributions for the 2-D global matched filter used 
on the Cylindrical Tank (F2) scene obtained through suboptimal sampling. 

The specified horizontal and vertical step size used to filter each image resulted in 

approximately 400 separate point evaluations within the specified field. Thus, Figure 15 

represents an empirical estimate of the N and SN distributions for the filter on a particular 

scene/sensor combination. The MATLAB code used to graphically display the results of 

the filter data is listed in Appendix J 
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E. 



DEVELOPMENT OF EMPIRICAL RECEIVER-OPERATOR CURVES 



A single filter output value taken by itself has no interpretive value. However, in 
relation to other matched filter outputs for N and SN from the same image, it becomes 
possible to predict both “hit” rates and “false-alarm” rates within the field evaluated by the 
matched filter. This can be accomplished by varying a threshold criterion (critical point) 
through the range of filter output values. Any SN filter value greater than this threshold 
criterion will be designated as a successful detection or “hit”, while any N filter value 
greater than this threshold criterion will be designated as a false detection or “false-alarm.” 
The total number of “hits” and “false-alarms” divided by the total number of trials (points 
evaluated) produces the “hit” rate (Pd) and the “false-alarm” rate (Pfa). 




Figure 16 . This illustrates the relationship between the threshold 
criterion (critical point) and the rate of detection (Pd) and rate of false 
alarm (Pfa) for a single threshold criterion (Schiffman, 1990). 

Thus, if we define the criterion as the maximum SN value, then there are no “hits” or 

“false-alarms” since there are no values greater than the criterion (the maximum). As the 

criterion is lowered, the number of “hits” begins to increase and the Pd becomes greater 

than zero. However, the “false-alarm” rate will also begin to increase as the threshold 

criterion starts to enter the range of the N distribution. As the criterion reaches the 
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minimum of the N filter output values, a hit rate of 100 percent would have already been 
achieved. However, since all of the N filter output values are greater than this minimum 
criterion, there is also a 100-percent false-alarm rate. Thus, an empirical ROC can be 
plotted simply by varying the threshold criterion from the maximum SN filter output value 
down to the minimum N filter output value, determining the hit and false-alarm rates at 
each threshold criterion, and plotting the resulting (Pd, Pfa) pairs. These ROC plots 
characteristically start at the (Pd=0%, Pfa=0%) point (threshold criterion at the maximum 
filter value) and end at the (Pd=100%, Pfa=100%) point (threshold criterion at the 
minimum filter value). 



Empirical ROC for 'Tower" Scene with Global Matched Filter 




Figure 17. Empirically-derived ROC plots for the 2-D global matched 
filters (including sensors IL, IR, and F2), as well as for the 3-D global 
matched filter (FI). 

The MATLAB 5.0 code to threshold and produce the empirical ROC plot is listed in 
Appendix I for the data placed in the “summary” variable. A separate m-file code was 
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developed to allow the recall of any of the ROC plots for later reference or analysis. This 
code is listed in Appendix J. 

F. DETERMINATION OF THE HUMAN VISUAL SYSTEM SENSITIVITY 
AND BIAS 

The subjects of the human factors experiments (Sampson, 1996) participated in a 
forced response (yes or no) two stimulus experiment in which one of the sensor “classes” 
from one of the three scenes were temporarily shown with or without a target present, and 
the subject’s reaction time for each response was recorded. However, in addition to 
recording the reaction time, the observer’s accuracy in response and the position of the 
target (if present) were also recorded. Thus, if the temporarily shown image contained a 
target (condition A), and the observer responded that a target was present (condition A), 
then a valid “detection” was recorded. But if the temporarily shown image did not 
contain a target (condition B), and the observer responded that a target was present 
(condition A), then a “false alarm” was recorded. For his experiment, Capt. Sampson 
developed images in which the target’s location had been digitally “moved” among three 
positions. Thus, the overall Pd and Pfa can be calculated for each of the three positions 
for any sensor “class” of any particular scene. This was accomplished by taking the raw 
data results of the human factors experiment (Sampson, 1996) and extracting the columns 
pertaining to: (1) the name of the person observing this image, (2) which sensor “class” of 
the scene was shown, (3) which scene was shown, (4) the position of the target (or no 
target), (5) the target condition presented, and (6) the observer’s response. This 
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produced a data set consisting of these six columns and 3240 rows. These data are the 
complied results of the five subjects whose responses were considered unbiased. 

An S-plus function called “CalcSensAndBias” (listed in Appendix K) was created 
to accept a dataffame with these six columns and any number of rows. In order for this 
function to execute correctly, the information must be formatted in the same column order 
as described above. This function calculates the number of correct detections (“AA” 
pairs) and false alarms (“BA” pairs) for each person for every scene/sensor combination 
for each target position. For the overall scores, the “AA” pairs of each subject were 
summed for each scene/sensor combination (similarly for the overall “BA”’s). From these, 
we calculate the Pd’s and Pfa’s by dividing by the number of observations for that 
particular case. As discussed in Chapter 2, solving for the sensitivity ( d ' ) is simply the 
inverse of the normal distribution for Pd minus the inverse of the normal distribution for 
Pfa. The sensitivity value can then be related to a general ROC plot since many values of 
Pd and Pfa can result in the same sensitivity. 




Figure 18. Examples of the general ROC plots for d’= 0, 
1, 2, and 3. (Schiffinan, 1990) 
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Furthermore, calculating the bias associated with the Pd and Pfa pairs is just as 
straightforward. Also discussed in Chapter 2, bias is simply the pdf of the normal 
distribution for Pd divided by the pdf of the normal distribution for Pfa. The computed 
sensitivities and bias are listed the Chapter 5 and in Appendix P for each subject (as well 
as for overall) across the combinations of scene/sensors for the three different positions. 

G. DETERMINATION OF MATCHED FILTER SENSITIVITY AND BIAS 

In evaluating the sensitivity of the human observers, the targets were placed at 
three different locations within each image. Thus, the resulting sensitivities calculated for 
each subject are a measure of the subject’s ability to discriminate the target from the 
background at these locations. Similarly, the ability for the matched filter to discriminate 
the target from the background at these location is directly related to the matched filter’s 
N and SN output values at these locations. As previously seen in Figure 15, the N and 
SN empirical distributions reflect how well the global 2-D matched filter can distinguish 
the target from the background as a whole throughout the field of interest. Thus, the 
matched filter’s sensitivity and bias at a specified location can be calculated by 
thresholding with respect to how well the same global 2-D matched filter can distinguish 
the target at the specified location. By using the matched filter’s N and SN output values 
at the specified location as the respective threshold criteria, denoted Nt and SNt 
respectively, one can estimate the detection rate (Pd) and the false alarm rate (Pfa) 
existing at this specified location. Any of the global 2-D matched filter SN output values 
from the specified field which are greater than the Nt value represents a target which is 
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successfully discriminated from th oackground noise at that location. However, any of 
the global 2-D matcheo ulter N output values from the specified field which are greater 
than or equal to the SNt value represents mistaking the background noise as a target. The 
Pd and Pfa for the specified location is then determined by counting the number of 
successful discriminations (hits) and the number of false detections (false alarms) and then 
dividing by the number of trials. Once the Pd and Pfa have been determined for the 
specified location, solving for the matched filter’s sensitivity and bias for that specified 
location is merely substitution into the respective equations. 

In order to obtain the Nt and SNt values at the locations corresponding to the 
positions used in the different scenes, an option to filter at a specified point instead of in a 
rectangular area was created. This uses the same code to filter a specified area, but is 
limited to a single iteration for the point specified and does not create matched filters. 
Instead, it uses the filters which have already been developed for the specified 
scene/sensor/and processing options saved in the corresponding coef ’ file. This ensures 
that the point is evaluated using the same filter with the same processing options as 
specified originally when filtering the corresponding specified field. This single point 
result is then saved with the save name convention as before with a “.dat” extension; 
however, instead of an “F” for the field option, there is a “P” for the point option. Since 
the target needs to be evaluated at three different locations per scene/sensor combination, 
the “P” series goes from “1” to “3”, resulting in three (“PI”, “P2”, and “P3”) point data 
files. 
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Once the field and associated point data files have been created, the matched filter 
output values for the point are used as the threshold criteria, and the sensitivity and bias 
associated with that point location are calculated and displayed. The m-file code to 
calculate the sensitivity and bias from the stored field and point “.dat” files is listed in 
Appendix J. 

H. OBTAINING THE CSF BASED IQM OUTPUT VALUES 

The Visual C++ programs for the CSF-based IQM were compiled and run on a 
Pentium micro-computer from a DOS window in Microsoft Windows ‘95. The program 
to reweight an image according to the parabolic model proposed by Pelli et al. (1990) 
required two filename inputs. The first was the filename of the image to be reweighted, 
and the second was the filename with which the reweighted image would be saved as. The 
image format required for this program was either a PNM or a PGM file format. Thus, 
the TIFF images were converted to PNM format images using Image Alchemy vl.9.1. 
Pseudo-colored images required the additional step of splitting the image into its RGB 
components through the use of a support program called “splitRGB.” 

The measure of contrast used for quantifying the “reweighted” contrast content 
within an image was a (9x9) mean-squared contrast filter, which measures contrast as the 
square of the mean differences summed over a (9x9) area of the image being evaluated. 
The contrast filter is filtered throughout the entire image and the output results summed to 
produce the overall contrast content contained within the image. 
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I. 



SETUP OF PLANNED COMPARISONS BASED UPON THE PROPOSED 



HYPOTHESES 

Multiple comparisons may be carried out on S-plus 4.0; thus, the contrast model 
ofAxBxCxD was required. The filter contrasts defined were: “cfl”, a comparison 
between the sensitivities resulting from the HVS (“H”) and the sensitivities of the global 
(“G”) and local (“L”) matched filters; “c£2”, a comparison between the sensitivities 
produced by the global and local matched filters; and “cf3”, a comparison between the 
sensitivities of the local and global matched filters to the sensitivities of the template 
matching filter. 

Contrasts defined for the sensors were: “csl”, a comparison between the 
sensitivities produced by the pseudo-color fused sensor and the sensitivities resulting from 
the individual EL and ER. sensors; “cs2”, a comparison between the sensitivities produced 
by the fused monochrome sensor and the sensitivities of the other sensors; and “cs3”, a 
comparison between the sensitivities produced by the IR sensor and the sensitivities 
produced by the EL sensor. 

Then, the interactions of interest were defined to include three of the two-way 



interactions between filter, scene, sensor, and position, as well as two three-way 



interactions. The S-plus code to accomplish these tasks are listed below: 



levels (Filter) = "G" "H” ”L" "T" 
levels (Sensor) = "fl" ”f2" "ii" "ir" 

cfilt<-cbind(cfl=c( -1, 2, -1, 0), cf2=c( 1, 0, -1, 0), cf 3=c ( 1, 0, 1, -2)) 
csensc-cbind (csl=c ( 2, 0, -1, -1), cs2=c ( -1, 3, -1, -1), cs3=c( 0, 0, -1, 1) ) 

mf<- aov(formula = Sensitivity - Sensor + Scene + Position + Filter + 

Sensor: Scene +Scene : Filter + Position: Filter + Sensor : Scene : Position + 
Sensor : Scene : Filter, data = D2.data, contrasts 3 list ( "Filter=cf ilt" , 
"Sensor=csens" , "Scene=contr. treatment (3) ”, "Position=contr . treatment 
( 3 ) " ) , na . action=na . omi t ) 
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J. TREND ANALYSIS OF THE MODELED RESULTS USING CENSORED 
REGRESSION 

Once the associated model output values had been obtained, comparison of the 
results of the contrast-based IQM and the calculated sensitivities were done using a non- 
linear censored regression model assuming a normal distribution. A MATLAB function 
called “CensoredRegrssnMLEs.m” was used to carry out Newton’s method using an 
accepted tolerance of 1 x 10' 10 . This function outputs the resulting estimated coefficients 
maximizing the log-likelihood equation discussed in the Chapter 3 (Models), and the 
asymptotic covariance matrix. In addition, the associated intermediate calculations are 
also displayed as the error term iterates toward zero. 

The human factors experiment (Sampson, 1996) was conducted such that each 
subject had an ample amount of time to visually search the image prior to responding. The 
mean reaction times and the accuracy data collected from that experiment indicated a 
weak, if any, speed-accuracy tradeoff. This tradeoff normally exists in speeded 
performance tasks and describes the reciprocity between latency and the number of 
incorrect responses made. Since this is not the case with the human factors experiment, 
the accuracy data and the reaction times should provide similar but independent measures 
of target discrimination. Thus, the mean reaction times should have a high degree of 
correlation to the calculated sensitivities for the human subjects. This allows the use of 
the mean reaction times as a continuous (non-censored) independent variable upon which 
to evaluate the effect of censored dependent sensitivities on ordinary least squares (OLS) 
estimates. The degree to which the censoring of the dependent variable affects the 
consistency of an OLS estimate can be seen in comparing the results of the estimated slope 
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and intercept coefficients produced by the non-linear censored regression to those 
resulting from ordinary least squares. Thus, OLS and non-linear censored regression 
coefficients were calculated using an Excel spreadsheet and the MATLAB function (listed 
in Appendix S) for each of the modeled output results regressed on the mean reaction 
times for the respective scene/sensor combinations. In addition, the results of each of the 
mathematical models were not regressed on the Human sensitivities due to both the 
response and independent variables having censored data. 
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V. RESULTS 



The data obtained using the matched filter and template matching models for the 
various sensor by scene combinations are graphically summarized in Appendix N. Figures 
13 and 15 presented examples of these summaries for the monochrome fused “cylindrical 
tank” for the global matched filter developed for this scene. An initial impression 
concerning how well the matched filter or the template matching filter discriminates the 
target from the background noise can be obtained by the amount of separation existing 
between the estimated N and SN distributions for each scene/sensor/filter combination. 
The a priori belief that the local matched filter would “outperform” the global matched 
filter in each scene was not constantly apparent. In some cases, the local filter seemed to 
result in a further overlap of the two empirical distributions. In fact, a larger separation 
was observed for only one of the three scenes (those scene containing the cylindrical 
tank). The threshold criteria (Nt’s and SNt’s) developed by filter evaluation at each of the 
three target positions are also listed in Appendix N for each respective scene/sensor/filter 
combination. 

Comparisons of the four different sensors for each of the scene/filter combinations 
used in this experiment have been summarized on nine different empirical ROC plots 
(Appendix O). These ROC plots graphically display the performances for both the global 
and local matched filters, as well as for the template matching performances. These are 
particularly interesting from the viewpoint that this graphically represents the information 
contained in the estimated N and SN distributions from the perspective of paired Pd and 
Pfa without any specific threshold criteria. As discussed earlier, when the sensitivity for 
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the filters are calculated, the response bias is also calculated; these are listed in Appendix 
P. The resulting response bias values obtained for all of the filters were roughly the same 
as those calculated for the human subjects. If these filters adequately model the HVS, 
then the specific point on the empirical ROC plots would roughly equal that of a human 
observer (or the filter for that matter). 



Empirical ROC for "Cylindrical Tank” Scene with Global Matched Filter 




Figure 19. Empirically derived ROC plot illustrating the Global matched 
filter’s sensitivities with the Cylindrical Tank scene for each sensor. 

The results of the template matching do not model the HVS response biasing at all, but 

provides basic information about which sensor was the most difficult to find the target in. 

However, even this information generally corresponds to those bands that performed the 

poorest in the human tests. 
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The filter sensitivities resulting from these threshold criteria for the global (G), 
local (L), and template matching (T) filters are listed in Table 1. Also listed in Table 1 are 
the overall sensitivity results based on the accuracy data and the mean reaction times for 
the subject to detect the target ( from the human factors experiment (Sampson, 1996)). 
Lastly, Table 1 also lists the corresponding output results of the contrast sensitivity 
function image quality metric (CSF IQM). 
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Sensor 


Scene 


Position 


Global 


Local 


Template 


Human 


CSF IQM 


Time (usees) 


FI 


ret 


1 


3.139 


0.325 


4.653 


4.020 


0.372204 


766.36 


F2 


ret 


1 


2.034 


2.382 


4.653 


4.020 


0.372303 


726.96 


IR 


ret 


1 


4.653 


3.571 


4.653 


4.020 


0.372109 


763.60 


IL 


ret 


1 


1.747 


2.314 


1.609 


3.511 


0.372471 


761.84 


FI 


tnk 


1 


4.653 


4.653 


4.653 


4.653 


0.372220 


617.49 


F2 


tnk 


1 


3.515 


4.653 


4.491 


4.336 


0.372385 


659.00 


IR 


tnk 


1 


4.653 


4.653 


4.653 


4.336 


0.372300 


583.38 


IL 


tnk 


1 


4.082 


1.271 


2.480 


4.028 


0.372249 


664.47 


FI 


twr 


1 


3.477 


2.107 


4.653 


4.336 


0.372315 


928.49 


F2 


twr 


1 


4.173 


3.075 


4.653 


4.336 


0.372430 


715.58 


IR 


twr 


1 


1.945 


3.123 


4.008 


2.466 


0.372291 


1201.44 


IL 


twr 


1 


4.132 


3.222 


4.653 


4.336 


0.372488 


667.18 


FI 


ret 


2 


1.214 


2.542 


4.653 


4.336 


0.372261 


723.33 


F2 


ret 


2 


1.722 


2.673 


4.653 


3.437 


0.372006 


938.18 


IR 


ret 


2 


4.653 


4.587 


4.653 


4.336 


0.372361 


747.40 


IL 


ret 


2 


1.112 


1.814 


1.756 


3.547 


0.372459 


772.18 


FI 


tnk 


2 


4.653 


4.653 


4.653 


4.653 


0.372365 


588.16 


F2 


tnk 


2 


4.551 


4.653 


4.491 


4.653 


0.372249 


585.42 


IR 


tnk 


2 


4.653 


4.653 


4.653 


4.653 


0.372217 


551.33 


IL 


tnk 


2 


3.497 


1.202 


2.674 


4.653 


0.372668 


650.80 


FI 


twr 


2 


4.653 


3.366 


4.653 


4.336 


0.371843 


599.13 


F2 


twr 


2 


4.241 


3.680 


4.653 


4.336 


0.372328 


608.09 


IR 


twr 


2 


0.800 


3.051 


4.008 


4.653 


0.372159 


686.73 


IL 


twr 


2 


4.132 


3.740 


4.653 


4.653 


0.372055 


565.22 


FI 


ret 


3 


2.136 


2.824 


4.653 


4.653 


0.372364 


781.67 


F2 


ret 


3 


2.280 


2.603 


4.653 


4.020 


0.372118 


845.40 


IR 


ret 


3 


4.653 


4.653 


4.653 


4.653 


0.372228 


698.49 


IL 


ret 


3 


1.342 


1.941 


1.655 


4.028 


0.372573 


751.89 


FI 


tnk 


3 


4.653 


4.653 


4.653 


4.653 


0.372458 


627.13 


F2 


tnk 


3 


3.257 


4.653 


4.491 


4.653 


0.372373 


585.82 


IR 


tnk 


3 


4.653 


4.653 


4.653 


4.336 


0.372184 


615.96 


IL 


tnk 


3 


1.984 


0.994 


3.025 


4.336 


0.372377 


757.11 


FI 


twr 


3 


4.152 


3.583 


4.653 


4.653 


0.372253 


673.67 


F2 


twr 


3 


4.447 


3.121 


4.653 


4.653 


0.372463 


619.80 


IR 


twr 


3 


1.719 


2.987 


4.008 


4.336 


0.372249 


803.56 


IL 


twr 


3 


3.977 


3.867 


4.653 


4.653 


0.371877 


594.42 



Table 1 . This table summarizes the sensitivity results for the global and local matched 
filters, the sensitivities for the template matching filter, and the overall results of the 
subjects participating in the human factors experiment (Sampson, 1996). Also listed are 
the corresponding output values from the contrast based IQM and the mean reaction 
times from the human factors experiment. Shaded cells contain sensitivity values which 
have been censored to a maximum value of 4.6527 (rounded to 4.653) 
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In order to better illustrate the relationship between these sensitivities and its 
range of detection and false alarm rates, the four sensitivities of each row may be plotted 
on a single ROC plot. 

An example of these results is shown in Figure 20 and listed in Appendix Q in the same 
order as in Table 1. The sensitivities from the filters represent the quantitatively modeled 
sensitivity performances of each filter. The HVS sensitivities represent the actual 
qualitative sensitivity performances of the human observers. 



ROCs for Cylindrical Tank (It) for AJI niters at Position I 




Figure 20. ROC plot based on calculated sensitivities from the Global and Local 
matched filters, the Template matching filter, and the overall sensitivity results of 
the human subjects. 

The sensitivity results were modeled with the sensor, scene, position, and filter as 
main effects, plus specific two-way and three-way interactions. The three two-way 
interactions included in this model were sensor by scene, scene by filter, and position by 
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filter. The two three-way interactions included in this model were sensor by scene by 
position, and sensor by scene by filter. The summary statistics for the main effects, the 
two-way, and three-way interactions are listed in Tables 2 through Table 10. These 
numbers reflect the mean (and variance) of the sensitivities corresponding to the main 
effect or interaction shown. 



Filter 




nw 


m 




3.370311 

(1.718986) 


4.385982 

(0.333780) 


3.235733 

(1.501949) 


4.17665 

(0.88853) 



Table 2. Mean (variance) of sensitivities by filter. 



p, Sensor'^SM 










4.265946 

(0.749956) 


4.167288 

(0.603163) 


3.725834 

(1.369461) 


4.197236 

(0.819675) 



Table 3. Mean (variance) of sensitivities by sensor. 



; ; || Scene ■ : 


ret 


tnk 


illllWIII : 


3.781346 

(1.310651) 


4.335793 

(0.608770) 


4.150089 

(0.704194) 



Table 4. Mean (variance) of sensitivities by scene. 



iRlIlllftaSi Position 




i >i iiiiii 




3.954007 

(1.021190) 


4.129856 

(0.934112) 


4.183365 

(0.800179) 



Table 5. Mean (variance) of sensitivities by position. 
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WM'WF Scene ' -P 


Filter 




tnk |P| 


" twr 


G 


2.556975 

(1.887544) 


4.066733 

(0.720071) 


3.487225 

(1.596225) 


H 


4.220105 

(0.409969) 


4.542125 

(0.111898) 


4.395717 

(0.437916) 


L 


2.685458 

(1.402824) 


3.778417 

(2.505373) 


3.243325 

(0.219060) 


T 


3.907808 

(1.816951) 


4.130567 

(0.735885) 


4.491575 

(0.084964) 



Table 6. Mean (variance) of sensitivities for filter by scene. 





; ; -:P - ? v- P PPP PosttioriPillS ■ IPPPl. 


Filter 




§li m ill 


iilllillili 


G 


3.516683 

(1.176958) 


3.323292 

(2.579346) 


3.270958 

(1.676644) 


H 


4.203833 

(0.569456) 


4.430417 

(0.260034) 


4.523697 

(0.128130) 


L 


2.945475 

(1.850193) 


3.384300 

(1.367333) 


3.377425 

(1.423513) 


T 


4.150733 

(1.036966) 


4.179167 

(0.914447) 


4.200050 

(0.874407) 



Table 7. Mean (variance) of sensitivities for filter by position. 





. . Scene \ 


Sensor 




Pvptnfcfpl-'; 


Jl'ltwr 


FI 


3.858747 

(1.544557) 


4.652698 

(3.9e-12) 


4.286393 

(0.440988) 


F2 


3.680562 

(1.038419) 


4.476560 

(1.657e-l) 


4.344743 

(0.277942) 


EL 


3.119437 

(1.585758) 


3.653359 

(1.587171) 


4.404706 

(0.184445) 


m 


4.466638 

(0.280758) 


4.560555 

(9.745e-2) 


3.564513 

(1.520873) 



Table 8. Mean (variance) of sensitivities for sensor by scene. 



63 






Scene by Position 1 


Sensor 


ret 


tnk 


twr * 


FI 


3.64600 

(2.19455) 


4.652697 

(2.285e-12) 


4.049222 

(0.882101) 


F2 


3.765083 

(1.165162) 


4.351959 

(2.601e-l) 


4.257272 

(0.3845237) 


IL 


3.144903 

(1.411401)) 


3.610608 

(1.462868) 


4.270559 

(0.3388849) 


IR 


4.241008 

(0.6721999) 


4.514484 

(1.528e-l) 


2.944284 

(1.3150168) 



Table 9.1. Mean (variance) of sensitivities for sensor by scene by 
position 1. 





Scene by Position 2 


Sensor 




llill 


" twr 


FI 


3.820746 

(1.7097588) 


4.652697 

(4.285e-12) 


4.353584 

(0.3091028) 


F2 


3.453208 

(1.1881292) 


4.619772 

(3.978e-3) 


4.341396 

(0.2233477) 


IL 


2.964662 

(1.7549734) 


3.829447 

(1.677025) 


4.473535 

(0.1210126) 


IR 


4.506209 

(0.1507578) 


4.652697 

(4.285e-12) 


3.890310 

(1.8819933) 



Table 9.2. Mean (variance) of sensitivities for sensor by scene by 
position 2. 





Scene by Position 3 


Sensor 


ret 


tnk 


; twr 


FI 


4.109485 

(1.045441) 


4.652697 

(4.285e-12) 


4.456372 

(0.1552901) 


F2 


3.823395 
(9.68 1 e- 1) 


4.457947 

(2.388e-l) 


4.435560 

(0.2871857) 


IL 


3.248745 

(1.996747) 


3.520021 

(2.017254) 


4.470022 

(0.1152815) 


IR 


4.652697 

(4.286e-12) 


4.514484 

(1.528e-l) 


3.858946 

(1.140124) 



Table 9.3. Mean (variance) of sensitivities for sensor by scene by 
position 3. 
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Sensor by Scene= u Rectangle’'i % 


Filter 


FI 


n - n 


"XL t'< 


il||ltlR:S 


G 


2.162800 

(0.9269369) 


2.012033 

(0.07824410) 


1.400367 

(0.103098663) 


4.652700 

(0.0000000) 


H 


4.431554 

(0.2095869) 


4.045513 

(0.47688795) 


3.971799 

(0.462484366) 


4.431554 

(0.3842423) 


L 


1.896700 

(1.8732126) 


2.552200 

(0.02308237) 


2.023000 

(0.067380430) 


4.269933 

(0.3678959) 


T 


4.652700 

(0.0000000) 


4.652700 

(0.00000000) 


1.673133 

(0.005688403) 


4.652700 

(0.0000000) 



Table 10.1. Mean (variance) of sensitivities for filter by sensor by scene (“Rectangle”). 





Sensor by Scene=“CyIindricai Tank” 


Filter 


FI : 


F2 


IL " 


IR 


G 


4.652700 

(0) 


3.774167 

(0.46956737) 


3.187367 

(1.17243466 


4.652700 

(0.0000000)) 


H 


4.652696 

(0) 


4.578982 

(0.08150601) 


4.431554 

(0.20958689) 


4.505268 

(0.1513683) 


L 


4.652700 

(0) 


4.652700 

(0.00000000) 


1.155567 

(0.02086860) 


4.652700 

(0.0000000) 


T 


4.652700 
(0) 


4.490700 

(0.00000000) 


2.726167 

(0.07644562) 


4.652700 

(0.0000000) 



Table 10.2. Mean (variance) of sensitivities for filter by sensor by scene (“Cylindrical 
Tank”). 





Sensor by Scene~“Tower” • 


Filter 


FI 


F2 


Hill 


IR 


G 


4.093800 

(0.3482844) 


4.286933 

(0.0203720) 


4.080333 

(0.007977363) 


1.487833 

(0.367387403) 


H 


4.505268 

(0.1513683) 


4.505268 

(0.1513683) 


4.578982 

(0.081506012) 


3.993348 

(1.226095276) 


L 


3.018300 

(0.6352025) 


3.291967 

(0.1133516) 


3.609700 

(0.116682210) 


3.053333 

(0.004602443) 


T 


4.652700 

(0.0000000) 


4.652700 

(0.0000000) 


4.652700 

(0.0000000) 


4.008200 

(0.0000000) 



Table 10.3. Mean (variance) of sensitivities for filter by sensor by scene (“Tower”). 
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A. 



ANOVA/PLANNED COMPARISONS ANALYSIS 



All four of the main effects were significant. The significance of sensor 
(F(3,210)=17.42, £<0.00001), showed the fused color sensor to have the highest 
sensitivity, followed by the infrared, the fused monochrome, and the intensified light 
sensors. The fused algorithm sensitivities were similar to the infrared band. A priori 
contrast showed that the fused monochrome sensor sensitivity was significantly different 
from those of the fused color, infrared, and intensified light sensors, F(l,210)=46.36, 
£<0.00001. This may have been a reflection of the notably different sensitivity results 
between the intensified light and the fused monochrome. The significance of scene 
(F(2,210)=30.66, £<0.00001), showed that some of the scenes, particularly the Rectangle 
scene, were not as accommodating to detecting the target as were the Tower or 
Cylindrical Tank scenes. This was evident in the mean reaction times collected in the 
human factors experiments (Sampson, 1996). The significance of filter (F(3,210)=81.48, 
£<0.00001), showed that the most discriminating and accurate “filter” was the HVS with 
the highest sensitivity. This was followed by the Template matching filter, then the Global 
and Local matched filters respectively. It is not particularly surprising that the Template 
matching filter produced a higher degree of accuracy than the matched filters. As 
explained previously, the Template matching filter looks for an exact digital match. Since 
this experiment provided the exact target to be located, the Template matching filter 
picked out the target perfectly without variance. A priori contrasts across filters showed 
that the Global matched filter differed significantly from the Local matched filter, 
F(l,210)=38.75, £<0.00001). While the Global and Local matched filter differed 
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significantly, F(l,210)=175.2, £<0.00001, indicating that sensitivity is influenced by the 
specified range of the scenes. Furthermore, both the Global and Local matched filters 
differed significantly from the Template matching filter, F(l,210)=30.49, p<0. 00001). The 
significance of position (F(2,210)=5.54, g<0.005) reflects the different target threshold 
criteria developed at each of the three target positions in each of the three scenes. 
However, as the results of the two- and three-way interactions are presented, target 
position becomes non-significant. 

The two-way interaction between sensor and scene was significant, 
(F(6,210)=23.76, g<0. 00001). This shows that regardless of the main effects of sensor 
and scene, the sensor producing the highest sensitivity was highly dependent upon scene. 
This is not surprising since the background content of each scene differs characteristically 
from each of the others’, resulting in a wide image quality range for any sensor from one 
scene to the next. A priori contrasts applied across specified sensors again showed a 
significant difference between the sensitivity results of the fused monochrome sensor and 
the other sensors, F(2,210)=17.28, g<0. 00001. This significant difference from either the 
infrared or the intensified light sensors was due to one of these single band sensors being 
significantly poorer than the other. 

Another significant interaction existed between scene and filter, F(6,210)=81.48, 
£<0.00001. This result showed that the best filter was highly dependent upon the scene 
used. A priori contrasts applied across specified filters with the various scenes showed 
that, regardless of the interaction between scene and filter, both the Global and Local 
matched filter sensitivities still differed significantly from the sensitivities obtained through 
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human factors testing, F(2,210)=14.36, £<0. 00001. However, in the sensor by filter 
interaction, the Global matched filter sensitivities were not significantly different from the 
Local matched filter sensitivities, F(2,210)=0.1072, £<0.8984. As before, both the Global 
and Local matched filter sensitivities remain significantly different from the Template 
matching sensitivities, F(2,210)=7.59, £<0.0007. The last two-way interaction included in 
this model, position by filter, was not significant, F(6,210)=1.61, £<0.1445. The 
insignificance of this interaction was due to each filter’s very similar sensitivities resulting 
from each of the three target positions used. 

The three-way interaction for sensor by scene by position essentially compared the 
sensitivity results from one target position with those of another position within the same 
sensor by scene combination. There was not enough evidence to show that the 
sensitivities evaluated at the three different target positions within the same scene were 
significantly different from one another, F(22,210)=1.14, £<0.3073. A priori contrasts 
comparing the fused color sensor sensitivity results to those of the infrared and intensified 
light sensors provided significant evidence that these sensors had the same sensitivity 
results, F(4,210)=0.09058, £<0.98534. However, the last interaction for sensor by scene 
by filter indicated that each of the filters performed significantly different for each of the 
12 scene/sensor images, F(27,210)=9.64, £<0.00001. Additionally, the a priori contrasts 
developed across specified filters further showed that the sensitivity results of the Global 
and Local matched filters differed significantly from those derived from the human factors 
experiment for the same sensor by scene images, F(6,210)=12.06, £<0.00001. In addition, 
the Global matched filter sensitivity results differed significantly from those produced by 
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the Local matched filter for the same scene/sensor images, F(6,210)=14.82, p<0. 00001. 
Also, the Global and Local matched filter sensitivities were significantly different from 
those of the Template matching filter, F(6,210)=9.93, g<0. 00001. A priori contrasts 
developed across specified sensors further showed that the sensitivities of the fused 
monochrome sensor differed significantly from those of the other sensors, 

F(6,210)=22. 16, £<0.00001. 



B. BONFERRONI TESTS FOR COMPARISONS 

Investigation of significant results found from the planned comparisons above 
further specified contrasts with sensitivity as the response variable. Listed in Tables 1 1 
through 14 are the resulting 95 percent simultaneous confidence intervals for the specified 
linear combinations, by the Bonferroni method with Sensitivity as the response variable 
(intervals excluding 0 are flagged by '****' ). The results of this post hoc analysis further 
compare the elements of the main effects of the ANOVA/Planned comparisons analysis in 
a pair-wise fashion. 





Estimate 


StdError 


Lower 

Bound 


Upper 

Bound 


G-jj **** 


-1.020 


0.0912 


-1.2600 


-0.773 


**** 


-0.806 


0.1180 


-1.1200 


-0.493 


H-L * * * * 


1.150 


0.0912 


0.9070 


1.390 


H-T 


0.209 


0.0912 


-0.0335 


0.452 


**** 


-0.941 


0.1180 


-1.2500 


-0.627 



Table 11. Results of the Bonferroni comparisons between Filter 
sensitivities (critical point: 2.6635 ) 
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Estimate 


Std. Error 


Lower Bound Upper 

Bound 


1-2 


-0.1250 


0.0912 


-0.345 


0.0949 


1-3 


-0.1390 


0.0912 


-0.359 


0.0812 


2-3 


-0.0137 


0.0912 


-0.234 


0.2060 



Table 12. Results of the Bonferroni comparisons between Position 
sensitivities (critical point: 2.4133 ) 



The results of the Bonferroni comparisons for Filter (see Table 1 1) shows the 
resulting comparisons between the sensitivities for each of the filters. The Template 
matching filter provided sensitivity values closest, in mean, to the Human sensitivities. 
However, due to the extreme digital precision with which this filter operates, it should not 
be a good approximation of the HVS responses. This should become apparent in 
regressing the Template matching sensitivity results on the qualitative Human data. Table 
12 shows the results of Bonferroni comparisons for the elements of the Position main 
effect. The results imply that the sensitivity results of the three different target positions 
presented did not necessarily impact the sensitivities for the various sensor by scene by 
filter combinations. This may not have been apparent in the ANOVA main effect for 
Position due to the large number of interactions incorporated into the model. Table 13 
further shows that the significance of the Scene main effect resulting from the ANOVA 
and Planned Comparisons were not due to a singular difference in only one of the three 
scenes, but, rather, due to all the scenes being different. The results displayed in Table 14 
shows that that the significance existing for the Sensor main effect was, in fact, primarily 
due to the sensitivities resulting from the single-band IL sensor and is apparent in Table 3 
or the summary statistics presented earlier. 
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Estimate 


Std Error 


Lower 

Bound 


Upper 

Bound 


rct-tnk **** 


-0.787 


0.0912 


-1.01000 


-0.567 


rct-twr **** 


-0.562 


0.0912 


-0.78200 


-0.342 


tnk-twr **** 


0.225 


0.0912 


0.00497 


0.445 



Table 13. Results of the Bonferroni comparisons between Scene 
sensitivities (critical point: 2.4133 ) 





Estimate 


Std. Err or 


Lower 

Bound 


Upper 

Bound 


F1-F2 


0.0441 


0.105 


-0.236 


0.324 


Fl-EL **** 


0.8780 


0.105 


0.597 


1.160 


Fl-IR 


-0.0824 


0.105 


-0.363 


0.198 


F2-IL **** 


0.8340 


0.105 


0.553 


-1.110 


F2-IR 


-0.1260 


0.105 


-0.407 


0.154 


EL-IR **** 


-0.9600 


0.105 


-1.240 


-0.680 



Table 14. Results of the Bonferroni comparisons between Sensor 
sensitivities (critical point: 2.6635) 



C. TREND ANALYSIS WITH CENSORED DATA 

The results of using the non-linear censored regression to approximate the MLE’s 
for the log-likelihood for each of the modeled results are listed in Appendix S and 
summarized in Table 15 below. The significance of the MLE coefficients was obtained by 
calculating the t-statistic for each of the coefficients. The t-statistic is calculated by 
dividing the MLE coefficients by their associated standard deviations. The only 
regressions that appear to be non-significant are the Template matching model and the 
contrast-based IQM model. 
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H-Time 


H-CSFIQM i 


G-Time 


L~Time 


T~Time 


Intercept 

(Variance) 


5.982633 

(0.004189) 


9.097626 

(1499.75) 


6.210681 

(0.0502) 


3.56043 

(.048387) 


3.53893 

(2.39919) 


Slope 

(Variance) 


-0.00256 

(7.107e-9) 


-12.92669 

(10821.01) 


-0.00455 

(9.06e-8) 


-0.00117 

(8.508e-8) 


-4.248e-4 

(3.459e-6) 



Table 15. Summary of the non-linear MLE estimates of the regression coefficients for 
the regression models (columns names). The letters are abbreviations for Human (H), 
Global (G) matched filter model, Local (L) matched filter model. Template (T) matching 
model, and CSFIQM for the contrast based IQM model. 



The results of the OLS regressions for the same models listed in Table 15, are summarized 
in Table 16. 





H-Time 


H-CSFIQM 


G-Time 


L-Time 


T-Time 


Intercept 


6.30369 


9.097626 


7.43154 


6.13259 


5.03044 


(p-value) 


(1.48e-22) 


(0.95745) 


(2.627e-8) 


(1.568e-6) 


(2.386 e-6) 


Slope 


-0.00286 


-12.92669 


-0.00575 


-0 004101 


-0.001209 


(p-value) 


(7.444e-9) 


(.977489) 


(3.352e-4) 


(0.00872) 


(0.336) 


Regression 

Significance 

F 


7.44e-09 


0.855 


3.35e-04 


8.72e-03 


0.336 


R-squared 


0.631 


0.000023 


0.319 


0.186 


0.027 



Table 16. Summary of the coefficients estimated using OLS regression and the 
respective p-values for the regression models (column names). The letters are 
abbreviations for Human (H), Global (G) matched filter model, Local (L) matched filter 
model, Template (T) matching model, and CSFIQM for the contrast based IQM model. 



For those regressions with significant coefficients, the MLE coefficients and the 
OLS coefficients will be nearly the same if the effect of censoring the dependent variable is 
minor. Thus, the effects of censoring are minor in the Human-Time as well as the 
Gobal-Time regression models. 

As predicted, the regression results for the Template matching model were non- 
significant. Although the Template matching sensitivities have a similar mean to the 



72 



Human sensitivities, the coefficient of correlation of only two percent suggests that this 
model fails to capture the “trends” represented in the Human data. The regression results 
of the contrast-based IQM was also non-significant. There appears to be sufficient 
evidence to suggest that the contrast-based IQM had no correlation to the trends 
represented in the Human data. In the case of the Local-Time regression, the censoring 
of the dependent variable had a major effect. Thus, the OLS regression results for the 
Local-Time regression were inconsistent and could not be used to infer any relationship 
between the Local matched filter sensitivity data and the Human data. 
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VI. CONCLUSIONS 



The area of sensor fused imagery has a large and diverse number of fusion 
algorithms and approaches to “improve” night vision displays. This thesis addressed the 
problem of quantifying the degree of enhancement achieved by fusion algorithms, based 
upon mathematical models of the HVS and search and detection theory. The four a priori 
hypotheses presented in the thesis background were developed to evaluate whether a local 
and global matched filter model, as well as a contrast based IQM model, could replicate 
the results of human subjects for the same “natural” and “coherent” scenes using actual 
targets. 

Based upon the results of regression analysis, there is significant evidence that 
there are large differences between the sensitivities produced by the Template matched 
filter and the results of the human data. The contrast-based IQM also demonstrated large 
differences between its estimated sensitivity performances of the various scenes and the 
results of the human data. However, in the case of the Global and Local matched filters, 
the resulting sensitivities tend to capture some of the trends seen in the data collected from 
the human factors experiment (Sampson, 1996). Of the four models evaluated, the Global 
matched filter produced the highest degree of correlation with the human data. These 
results are particularly important in that Sampson carried out the human factors 
experiment with the expectation that the fused colored images would produce the shortest 
reaction times in each of the scenes presented. He based this expectation on the superior 
results predicted by the Global matched filter for a simulated target within a completely 
different background image. As the results of the large number of significant interactions 
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across scene indicate, it is not possible to make this generalization. However, as can be 
seen by the empirically derived ROC plots for the Cylindrical Tank and Tower scenes with 
the Global matched filter (see Appendix R) with the targets placed in their original 
positions (position 1), the estimated performances of the four different sensors track well 
with the mean reaction times collected from the human factors experiment. Most 
importantly, these empirical ROC plots of the Global matched filter correctly identified 
that the fused color or fused monochrome image would not outperform the single band 
infrared or intensified light band for that target and background imagery. Although there 
are significant differences based upon the ANOVA, this is more of a reflection of the 
differences in the sensitivity “operating range” of the four different models which is a 
reflection of the obvious differences apparent in the summary statistics presented earlier. 

Despite the similarities of the Global and Local matched filter development, there 
are still significant differences in the predicted sensitivity results for the same images. This 
was most apparent from the ANOVA, which showed that these two matched filters are 
significantly different. However, the a priori expectation that the Local matched filter 
should outperform the Global matched filter does not appear to be the case. Based upon 
the higher degree of correlation between the Global matched filter and the Human data, 
truncating the spatial image, and consequently the spectral content, of the background 
used to develop the matched filter coefficients does not increase performance. 

The inclusion of the Template matching filter provided a basis for comparing the 
Global and Local matched filters (which model the HVS) with a standard image 
processing search filter (which does not model the HVS). The resulting statistical analysis 
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showed that there was almost no relationship between the sensitivities predicted by the 
Global or Local matched filters and the Template matching filter for the respective scenes. 
Since the Global and Local matched filters follow the sensitivity trends of the Human data 
rather than the Template matching filter, the Global or Local matched filter process 
appears to be a viable model of the HVS. 

Although the degree to which the Global or Local matched filter sensitivities 
correlate to the Human data is not accurate in all cases, the Global matched filter 
moderately predicted which of the single-band sensors (infrared or intensified light), as 
well as which of the fused sensors (color-fused or monochrome-fused) provided the higher 
sensitivities in the majority of the cases. Thus, it still might be possible to use the Global 
matched filter concept developed for this experiment to evaluate and compare the many 
different fusion algorithms being proposed. 

A number of factors could be handled differently and the effects these variations 
have on the accuracy of the sensitivities predicted by the Global matched filter 
investigated. The empirical distributions shown in Appendix N reflect that, in the majority 
of the scenes, the noise and signal+noise distributions have unequal variances. The search 
and detection procedure used for this experiment assumed equal variances when 
calculating the filter sensitivities. However, the scenes that provided the highest degree of 
correlation with the human data are those that tended to display fairly equal variance in the 
empirical histograms. A procedure exists which allows the calculated sensitivities to be 
“scaled” to account for unequal variances is covered extensively in Gescheider (1985). 
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Also, in the development of the matched filters, certain assumptions may have 
affected the resulting matched filter coefficients to some degree. When the matched filters 
were created, the filter was enlarged proportionally, based upon the size of the target. The 
amount of background to include in the filter evaluations could arguably be of a higher 
proportion. However, the enlarged filter was kept rather limited because, as filter size 
increases, the processing time required to carry out even a suboptimal sampling of the 36 
scenes processed increases exponentially. Additionally, the threshold criteria used in 
developing the sensitivities from the empirical distributions were chosen to reflect how 
well the matched filters could distinguish the target from the background at the same 
locations used in the human factors experiment. The empirical ROC plots listed in 
Appendix O still reflect the same “trends” as the Human data without a specified threshold 
criterion. Since the suboptimal sampling of the scene allows the estimation of the noise 
and signal+noise distributions, the sensitivity of a particular scene could be calculated 
directly from the difference in the means of these distributions while scaling for unequal 
variances. 

The limited number of scenes available for these evaluations may have also 
contributed another component of uncertainty. This is because all the scenes used for this 
and the human factors experiment were digitally “processed” to create the same scenes 
with and without targets at the three different locations. This was accomplished by taking 
scenes in which the target existed already and digitally moving the target to other locations 
within the scene. In order to produce this same scene without a target present, a section 
of background “visibly” similar to the target area was cropped and placed over the target. 
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While this may be appropriate for the human factors experiment, it is definitely not 
arguably sound for evaluations with digital filters. Datasets of images need to be 
collected, some with targets already existing in the various locations as well as without the 
target present. This would also remove any issues concerning the influences of luminance 
and reflectivity of the target’s appearance in different locations. 

Of the four models evaluated in this experiment, the Global matched filter came 
out as the best candidate for predicting the target detection abilities of the human visual 
system. However, there are many refinements which need to be explored in order to 
increase the degree of correlation with the human factors data. The fact that the contrast- 
base IQM performed so poorly attests to the difficulties in incorporating the human visual 
system into standard image processing techniques. However, the matched filter process 
appears to be a viable model of the human visual system. 
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APPENDIX A. MATCHED FILTER MAIN PROGRAM (MATLAB) 



Filename: go_MCfilter.m 

% 

% MAIN PROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master's Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 

% 

% 

% This is the Main Program of the Matched Filter program. It "coordinates" 
% the main program steps. The following is a list of Variables used throughout 
% the m-file code. 

% 

% 

% b : holds the original background image loaded for the blue component. 
% b_mean : holds the mean of the specified field of interest for the blue 
% component image. 

% b_std : holds the standard deviation of the specified field of interest 
% for the blue component image. 

% bkgd_r : assigned the red background (or the only background to be 
% filtered) once any preprocessing has been carried out on the 

% original background image (variable r). 

% bkgd_g : assigned the green background once any preprocessing has been 
% carried out on the original background image (variable g). 

% bkgd_b : assigned the blue background one any preprocessing has been 
% carried out on the original background image (variable b). 

% BNtype : either [N]ormalize the background image or leave [U]nnormalized. 
% Choice : [Fjield filtering option or [P]oint filtering option 
% Filtertype: [L]ocal or [G]lobal matched filters or [Template matching. 

% fil_NNR_2db: "Noise" output value for h_b filter at the specified point. 

% fil_NNR_2dg: "Noise" output value for h_g filter at the specified point. 

% fil_NNR_2dr: "Noise" output value for h_r filter at the specified point. 

% fil_NNR_3d: Summed "Noise" output value from hi, h2, and h3 3D filters. 
% fil_SNR_2db: "Signal+Noise" output value for h_b filter at the specified 
% point. 

% fil_SNR_2dg: "Signal+Noise" output value for h_g filter at the specified 
% point. 

% fil_SNR_2dr: "Signal+Noise" output value for h_r filter at the specified 
% point. 

% fil_SNRJ3d: Summed "Signal+Noise" output value for hi, h2, and h3 3D 
% filters. 

% Foptions: string made up of the filter options: [Process, BNtype, TNtype, 

% Filtertype, Choice, (F orP)Series] ie: "1NNGF1" 

% FSeries : Field "series" are numaerically ordered integers for multiple 
% fields to be saved with the same filename conventions. 

% g : holds the original background image loaded for the green 
% component image. 

% g_mean : holds the mean of the specified field of interest for the green 

% component image. 

% g_std : holds the standard deviation of the specified field of interest 
% for the green component image. 

% hi : the 3D filter coefficients for the red component. 



81 



% hi : the 3D filter coefficients for the green component. 

% h3 : the 3D filter coefficients for the blue component. 

% h_r : the 2D filter coefficients for the red component. 

% h_g : the 2D filter coefficients for the green component. 

% h_b : the 2D filter coefficients for the blue component. 

% h_123_dim: [row,col] dimension of the 3D red, green, and blue filters. 

% h_rgb_dim: [row, col] dimension of the 2D red, green, and blue filters. 

% Imagename: holds a name string of the background image. 

% index: an sequentially numbered vector of numbers from 1 to the number of 
% points within the specified field which have been evaluated. 

% keep_b : [Y]es to indicated keeping the blue component or [N]o. 

% keep_C : [Y]es to indicated keeping the Color component or [N]o. 

% keep_g : [Y]es to indicated keeping the green component or [N]o. 

% keep_r : [Y]es to indicated keeping the red component or [N]o. 

% m : holds the number of rows in the background image. 

% m_offset: holds the row offset when the background image is truncated to a 
% smaller area withing the original image (such as in the 

% case of a locally derived matched filter). 

% mm : holds the half-height of the background image. 

% n : holds the number of columns in the background image. 

% n_ofifset: holds the column offset when the background image is truncated 
% to a smaller area within the original image (such as in the 

% case of a locally derived matched filter). 

% noise_l: assigned the "noise" only values of bkgd_r filtered with hi. 

% noise_2: assigned the "noise" only values of bkgd_r filtered with h2. 

% noise_3: assigned the "noise" only values of bkgd_r filtered with h3. 

% noise_r: assigned the "noise" only values of bkgd_r filtered with h_r. 

% noise_g: assigned the "noise" only values of bkgd_r filtered with h_g. 

% noise_b: assigned the "noise" only values of bkgd_r filtered with h_b. 

% nn : holds the half-width of the background image. 

% o*** : when placed before a variable in this list, it is used to hold 

% the original value of the variable since it will be changing. 

% outputl: assigned the "Signal+Noise" contributions from the red component. 
% output2: assigned the "Signal+Noise" contributions from the green 
% component. 

% output3: assigned the "Signal+Noise" contributions from the blue component. 
% Process: holds the chosen filter processing options. 

% [1] Process a single "color" image (includes fused monochrome). 

% [2] Process multiple bands iot predict fused image performance. 

% [3] Process a color fused image by its RGB components. 

% PSeries : Point "series" are numaerically ordered integers for multiple 
% points to be saved with the same filename conventions. 

% r : holds the original background image loaded for the red component. 

% r_mean : holds the mean of the specified field of interest for the red 
% component image. 

% r_std : holds the standard deviation of the specified field of interest 
% for the red component image. 

% scene_r: assigned a filter-sized image segment of the red background image 
% for use in convolving with the h_r or hi filters. 

% scene_g: assigned a filter-sized image segment of the red background image 
% for use in convolving with the h_g or h2 filters. 

% scene_b: assigned a filter-sized image segment of the red background image 
% for use in convolving with the h_b or h3 filters. 

% summary: a two dimensional dataframe storing the "Noise" and 
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% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 
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% 
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% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 



"Signal+Noise" output values of each of the filters at each 
point (specified by the chosen filtering options) in the format: 

[index, fil_SNR_2dr, fil_SNR_2dg, fil_SNR_2dg, fil_SNR_3d, 
fil_NNR_2dr, fil_NNR_2dg, fil_NNR_2dg, fil_NNR_3d, row#, col#] 
sumdim: the [row,col] dimensions of the 2-D dataffame holding the 
t_r : holds the target image for the red (or only band specified) image. 
t_g : holds the target image for the green image. 
t_b : holds the target image for the blue image. 

Targetname: holds a name string of the target image. 

Tml : holds the number if rows in the target image. 

Tm2 : holds the half-height of the target image. 

Tm3 : holds the half-height of the filter. 

Tm4 : holds the number of rows in the filter. 

Tnl : holds the number of columns in the target image. 

Tn2 : holds the half-width of the target image. 

Tn3 : holds the half-width of the filter. 

Tm4 : holds the number of columns in the filter. 

TNtype : holds either [N]ormalize the target image or leave [U]nnormalized. 
Tr_template: holds the target template for used with t_r. 

Tg_template: holds the target template for used with t_g. 

Tb_template: holds the target template for used with t_b. 

UniformCheck: an attempt to determine if the target to be used is a 
uniform grey-level such was the case with some of the 
synthetic targets used for run checks. 

Xmax : maximum column number of the field specified to be filtered. 

Xmin : minimum column number of the field specified to be filtered. 

Ymax : maximum row number of the field specified to be filtered. 

Ymin : minimum row number of the field specified to be filtered. 



These include calls to other subroutines summarized as follows: 



"get images": This m-file allows a choice of Processing options which then 
determines the number and types of TIFF images which need to be openned. 
Once this has been specified this routine uploads the three image files 
required, (1) background image, (2) target image, and (3) a target 
template image. More than one image set of three may be used in the 
case of processing options (2) and (3). 

"get_filt_images”: This m-file gets the inputs for the various filtering 
options: 

(1) Preprocess (normalize) the background or target, both, or 
none. 

(2) Choice of filter type: (G)lobal matched filter, (L)ocal matched 
filter, or (T)emplate matching 

(3) Area within image to be processed: (F)ield or (P)oint 

Note: In order to use the (P)oint option, the (F)ield option would have 
already been run since the (P)oint option uses the filter coefficients 
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% derived and saved as well as the same preprocessing options. Thus, when 
% (P)oint is specified, the program looks for the file it created and 
% stored the filter coefficients for the currently specified background 
% image, target, preprocessing, and Field serial number. 

% 

% ”do_preprocessing": This m-file carries out any specified normalization to 
% the background(s) and target(s) as w ell as truncates the background to 
% be used in developing a locally matched filter and "local” evaluations. 

% 

% "filter_image": This m-file carries out filtering the background image(s) 

% with the developed filter(s) at the specified point or at the specified 
% horizontal and vertical step sizes within the specified field in a 
% sequential manner. 

% 

% "conv_image": This m-file does the same filtering process as filter_image 
% but does this by inserting targets at several locations at once. 

% How ever, the speed advantage of going this route depends on the size of 

% the target with respect to the specified field to be filtered. In 
% certain situations where the number of targets which can be fit within 
% the specified field are above 300 or more, this method should save time. 

% 

% "roc9": This m-file creates an empirical ROC plot of the individual bands 
% as well as any specified "fused" band results and saves the plot summary 
% for recall using the recall_roc9 m-file. 
clear 

get_images; 

get_filt_info; 

do_preprocessing; 



if (Filtertype— L' | Filtertype— 'G') & (Choice— F) 
make_GLfilters 

elseif (Filtertype— T') & (Choice='F) 
make_Tfilters 
end; 

if ((Filtert\pe=’L')|(Filtert>pe=T))&(Choice=F) 
if ((Xmax-Xmin)/Tn4)*((Ymax-Ymin)/Tm4)>200 
conv_image 
else 

filter_image 

end; 

else 

filterimage 

end; 

ifChoice='F 

roc9; 

end; 
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APPENDIX B. M-FILE TO LOAD IMAGES AND TARGETS 



filename: get images.m 



% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master's Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 
% 

% 

% This MATLAB m-file is a sub-program of "go_MCfilter". This routine 
% allows specification of the type if "processing" which is to be carried 
% out on and image(s). It is written to handle TIFF image files saved with 
% either the "indexed" or "RGB" option. 

% Processing options: 

% [1] If the first process is chosen, then the image and target are 

% converted to a grayscale image and filtered. 

% [2] If the second process is chosen, then a different sensor/image 

% may be entered for each of the color bands (up to three: red, green, and 
% blue). For instance, a long-wave JR image/target can be designated to the 
% red component, a medium-wave IR image can be designated to the green 
% component, and a short-wave IR image can be designated to the blue component. 
% This processing option will calculate the filters for each of the bands and 
% filter the image as specified for the individual band results. It will then 
% calculate the 3-D results of fusing the component images using 3-D filters. 

% [3] If the third option is chosen, then a pseudo-color image 

% should be specified and the image will be split into its RGB components and 
% if redundant components exit, then an option to specify which components to 
% keep will appear since the results of redundant bands will be identical. 

% This option then processes the individual components and then the fused 
% 3-D result as in option two. 

% 

% 

% Uses: (other m-files) 

% choose_components. m 

% get_file.m 

% 

% 

dispO '); 
dispO '); 
dispO '); 
dispO ’); 

dispO Matched filter processing options:'); 
dispO '); 

dispO [1] Process a single "color" image (includes fused monochrome).'); 
dispO '); 

dispO [2] Process multiple bands iot predict fused image performance.'); 
disp(' '); 

dispO [3] Process a pseudo-color fused image by its RGB components.'); 
dispO ’); 
dispO '); 
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Process=input('Enter Processing option: '); 
disp(' '); 
if Process=2 
dispC ’); 
dispO ’); 

Nonsns=l; 

msg=’N'; keep_r='*'; keep_g=’*'; keep_b=’*'; keep_C-Y’; 
[keep_r,keep__g,keep_b]=choose_components(Nonsns,Nonsns,Nonsns,msg); 
clear msg Nonsns 

TProcess=l; dumb 1=0; dumb2=0; dumb3=[]; FusedImage=Q; Fusedtarget=[|; m=0; n=0; 
r=U; g=[]; b=[]; t_r=[]; t_g=[]; t_b=[]; Trjemplate=[]; Tg_template=Q; Tb_template=[]; 

if keepi^’Y’ 

dispC •); 
dispC •); 

disp(’Enter the name of the RED BACKGROUND image to be used (".tiff’) assumed’); 
Imagename=input(’:: 7s'); 

[Fusedlmage,m,n,r,dumb 1 ,dumb2]=get_file(FusedImage,Imagename,Process, r,dumb 1 ,dumb2); 
dispC ’); 
dispC ’); 

disp('Enter the name of the RED TARGET to be used (".tiff* assumed)'); 

Targetname=input(':: Vs'); 

|Eusedtarget,Tml,Tnl,t_r,dumbl,dumb2]=get_file(Fusedtarget,Targetname,TProcess,t_r,dumbl,dumb2); 

dispC '); 
dispC ’); 

disp('Enter the RED TARGET TEMPLATE filename (".tiff assumed)'); 

Tempname=input(’:: ','s'); 

[dumb3. Tml,Tnl.Tr_template. dumb l,dumb2]=get_file(dumb3,Tempname,TProcess,Tr_template, dumb 1. 
dumb2); 
end; 



if keep_g='Y' 
dispC ’); 
dispC '); 

disp('Enter the name of the GREEN BACKGROUND image to be used (".tiff) assumed'); 
Imagename=input(':: ','s'); 

[FusedImage,m,n,g,dumbl,dumb2]=get_file(FusedImage,Imagename,Process,g,dumbl,dumb2); 
dispC '); 
dispC ’); 

dispCEnter the name of the GREEN TARGET to be used (".tiff" assumed)'); 

Targetname=input(':: ','s'); 

[FusedtargeLTml,Tnl,t_g,dumbl,dumb2]=get_file(Fusedtarget,Targetname,TProcess,t_g,dumbl,dumb2); 
dispC '); 
dispC '); 

disp('Enter the GREEN TARGET TEMPLATE filename (".tiff” assumed)'); 

Tempname=input(':: ','s'); 

[dumb3,Tml,Tnl,Tg_tempIate,dumbl,dumb2]=get_file(dumb3,Tempname.TProcess,Tg_template,dumbl, 

dumb2); 

end; 
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if keep_b='Y' 
dispC ’); 
dispC ’); 

disp('Enter the name of the BLUE BACKGROUND image to be used (".tiff') assumed'); 
Imagename=input(':: Vs'); 

[FusedImage,m,n,b,dumbl,dumb2]=get_file(FusedImage,Imagename,Process,b,dumbl,dumb2); 

dispC ’); 
dispC '); 

disp(’Enter the name of the BLUE TARGET to be used (".tiff" assumed)'); 

Targetname=input(’:: Vs’); 

[Fusedtarget,Tml,Tnl,t_b,dunibLdumb2]=get_file(Fusedtarget,Targetname,TProcess,t_b,dumbl,dumb2); 
dispC '); 
dispC '); 

dispCEnter the BLUE TARGET TEMPLATE filename (".tiff' assumed)'); 

Tempname=input(':: ','s'); 

[dumb3 ,Tm 1 ,Tn 1 ,Tb_template,dumb 1 ,dumb2]=get_file(dumb3 ,Tempname.TProcess,Tb_template, dumb 1 , 
dumb2); 
end; 

Imagename=FusedImage; 

Targetname=Fused target; 

clear Fusedlmage Fusedtarget TProcess dumbl dumb2 dumb3 Tempname; 
else 

if Process=l 
keep_r=’Y’; 
keep_g='N'; 
keep_b='N'; 
keep_C='N'; 
else 

keep_r='Y'; 

keep_g='Y'; 

keep_b='Y'; 

keep_C='Y'; 

end; 

TProcess=l; dumb 1=0; dumb2=0; dumb3=[]; m=0; n=0; r=[]; g=[]; b=[]; 

Tml=0; Tnl=0; t_r=[]; t_g=[]; t_b=[]; Tr_template=[]; Tg_template=[]; Tb_template=[]; 
dispC '); 
dispC ’); 

disp(’Enter the name of the BACKGROUND image to be used (''.tiff') assumed'); 

Imagename=input(':: ','s'); 

[dumb3,m,n,r,g,b]=get_file(dumb3,Imagename,Process.r,g,b); 

disp("); 

dispC '); 

disp('Enter the name of the TARGET to be used (".tiff' assumed)'); 

Targetname=input(':: ','s'); 

[dumb3,Tml,Tnl,t_r,t_g,t_b]=get_file(dumb3,Targetname,Process,t_r,t _g,t_b); 

disp("); 

dispC '); 

disp('Enter the TARGET TEMPLATE filename (".tiff 1 assumed)'); 

Tempname=input(':: ',’s'); 

TProcess=l; 
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[dumb3,Tml,Tnl,Tr_template,dunibl,duinb2]=get_file(duinb3,Tempname,TProcess,Tr_template,dumbl, 

dumb2); 

Tg_template=Tr_template; 

Tb_template=Tr_template; 
clear dumbl dumb2 dumb3 TProcess 
end; 
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M-file to choose color components. 

filename: choose_components.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master's Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 
% 

% 

% This MATLAB m-file is a sub-program of "go_MCfilter". This routine 
% allows specification of the number of components to be included in the 
% development and evaluation of two options. In the case of processing 
% option [2], it specifies which bands are to be fused together such as 
% in the case of fusing up to three different bands (colors). In the 
% case of processing option [3], it specifies the actual RGB color bands 
% w hich are to be evaluated when one of more of the bands are redundant. 

% 

% 

function [keep_r, keep_g, keep b] = choose_components (r_equals _g,r_equals_b,g_equals_b,msg); 



if msg='Y' 
dispC '); 
dispC ’); 

(jjgpC ******************************** y 

dispC ********* REDUNDANT COMPONENTS EXIST ****♦****•); 

******************* *************y 

dispC ’); 

if r_equals_g = 0 

dispC RED component identical to the GREEN component...'); 
elseif r_equals_b =0 

dispC RED component identical to the BLUE component...’); 
elseif g_equa!s_b = 0 

dispC GREEN component identical to the BLUE component...'); 
end; 
end; 

Pick-*'; 
while Pick='*' 



dispC '); 

dispC Choices: '); 

disp(’ [S] SPECIFY the components to continue with’); 
dispC [A] continue with ALL THREE components'); 
dispC *); 

Pick = inputC Enter an "S" or "A” :: \'s'); 
if Pick~'S' & Pick^’A’ 



Pick- *'; 
end; 
end; 

if Pick = 'S' 



keep_r='*’; 
keep_g=’*’; 
keep_b=’*'; 
dispC '); 
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disp(*Enter "Y" to include the component in the analysis, or "N" to exclude...’); 
dispC '); 

while keeper— ’Y' & keep_r~'N' 
keep_r = input('RED ? (”Y" or ”N”) : ’/s’); 
end; 

while keep_g~ Y' & keep_g~ N' 
keep_g = input(’GREEN ? ("Y" or "N”) : Vs'); 
end; 

while keep_b~='Y’ & keep_b^’N' 
keep_b = input('BLUE ? ("Y" or ”N M ) : \'s’); 
end; 
end; 
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M-file to load tiff images. 



Filename: get_file.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master's Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 
% 

% 

% This MATLAB m-file is a sub-program of "go_MCfilter". This routine 
% is used to read in the TIFF formatted image files. There are to formats 
% of TIFF images. If Tifftype=8 then the file has been stored in the 
% "indexed" format. If Tiffiype=24 then the file has been stored in the 
% "RGB" format. Each requires different loading assignments and are 
% distinguished automatically and read in appropriately. 

% 

% 

function [Fusedname,mdim,ndim,compl,comp2,comp3] = get file (Fusedname, Name, 
Process, comp l,comp2,comp3) 

filename= [Name, '. tiff] ; 

Fusedname= [Fusedname,Name] ; 

T iffType=tifif ead 1 (filename) ; 
if TiffType=8 
[x,map]=tifffeadl (filename); 

% RE-FORMAT BACKGROUND DATA, 
if Process=3 

disp('Re-formating INDEXED Background data into RGB...') 

[comp l,comp2,comp3]=ind2rgb(x, map); 
else 

compl=ind2gray(x,map); 

comp2=[]; 

comp3=[]; 

% display using imshowl (comp 1,64) command 
end; 

[mdim,ndim]=size(compl); 
elseif T iflfType=24 

[comp 1 , comp2 , comp3 ] =tiffr ead 1 (filename) ; 
if Process=l 

comp l=rgb2gray (comp 1 ,comp2 ,comp3); 

comp2=[]; 

comp3=[]; 

% display using imshowl(r,64) command 
end; 

[mdim,ndim]=size(compl); 

else 

disp('This file does NOT conform to INDEXED or RGB as expected...'); 
end; 
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APPENDIX C. M-FELE TO INPUT FILTERING OPTIONS 



Filename: get_filt_info.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master's Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% 

% This MATLAB m-file is a sub-program of "go_MCfilter". This is just a 
% a series of questions in order to get the filtering information and 
% preprocessing options. 

% 

% 

% Query whether background image and/or/nor target are to be Normalized... 

BNtype-*'; 

TNtype-*'; 

while BNtype~='U' & BNtype—'N' & TNtype~='U' & TNtype~='N' 
dispC '); 
disp(' ’); 

BNtype=input('Leave the BACKGROUND image [U]n-normalized or [Njormalize: ’,'s'); 

dispC); 

dispC '); 

TNtype=input('Leave the TARGET image [U]n-normalized or [Njormalize: ', ’s'); 
end; 



% Query whether this will be using a Local or Global Matched Filter or a 
% Template matching filter. 

Filtertype-*'; 

while Filtertype~='L' & Filtertype~='G' & Filtertype~='T' 
dispC '); 
dispC ’); 
dispC ’); 

disp('Matched Filter processing using: '); 
dispC '); 

dispC 1 L ] Local Matched Filter'); 

dispC (Developed using the statistics of a specified field or point within BKGD).'); 

disp(' [ G 1 Global Matched Filter’); 

dispC (Developed using the statistics of the entire BKGD image).'); 

dispC [ T ] Target "as is" as Filter'); 

disp(' '); 

disp("); 

dispC); 

Filtertype=input('Enter an "L", "G" or a "T" : ’s’); 

end; 

% Determine target and filter dimensions 
nn=round((n/2)-0.0 1); 
mm=round((m/2)-0.01); 

T m2=round((T m 1 - 1 )/2); 

T n2=round((T n 1 - 1 )/2) ; 
if Filtertype='T' 
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Tm3=Tm2; 

Tn3=Tn2; 

else 

Tm3=(Tm2 + round(sqrt(Tml))); 

Tn3=(Tn2 + round(sqrt(Tnl))); 
end; 

Tn4=(2*Tn3+l); 

Tm4=(2*Tm3+l); 

% Placement of a target in a specified field or point within the background image 
Choice-*'; 

w hile Choice— 'F' & Choice— 'P' 
dispC ’); 
dispC '); 

disp('Target placement:'); 
dispC '); 

dispC [F] Evaluation of target at intervals within a specified FIELD'); 

dispC [P] Evaluation of target at a single specified POINT (with prev. calc, coefs.)'); 

dispC '); 

Choice=input('Choose [F] or [P] : ','s'); 
end; 

% Initialize range variables and show r the target's dimentions so that the user can choose a horizontal and 
vertical step size. 

Xmin=0; 

Xmax=0; 

Ymin=0; 

Yma\=0; 
dispC ’); 
dispC ’); 

disp( ['background image dimensions are: (height x width) = (',int2str(m),' x ',int2str(n), ')']); 
dispC '); 

disp(['Target filter dimensions are : (height x width) = (’,int2str(Tml),' x ',int2str(Tnl),')']); 



if Choice='F % if [F]ield is specified, the get the comer points of the 
% specified field and adjust the background as necessary. 



dispC ’); 
dispC '); 

skipX = input('Enter the HORIZONTAL interval for target insertion into the field: '); 
dispC '); 

skipY = input('Enter the VERTICAL interval for target insertion into the field: '); 
dispC ’); 

dispC Placement of target(s) in a specified field with specified intervals'); 
dispC ‘); 

disp('Enter the (x,y)-coords of the upperleft and lower right comers of the field:'); 
while Xmin<Tn3+l | Xmin>(n~Tn3) | Xmin>Xmax | Xmax<Tn3+l | Xmax>(n-Tn3) | Ymin<Tm3+l | 
Ymin>(m-Tm3) | Ymin>Ymax | Ymax<Tm3+l | Ymax>(m-Tm3) 
dispC ’); 

dispC* **NOTE: X values must be between:'); 
dispC Min Max'); 
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disp([Tn3+l, n-Tn3]); 

disp('***NOTE: Y values must be between:'); 
disp(' Min Max'); 
disp([Tm3+l, m-Tm3]); 

Xmin = input(' Enter the upper left X-coords of field : ’); 

Ymin = input(' Enter the upper left Y-coords of field : '); 

Xmax = input(' Enter the lower right X-coords of field as: '); 

Ymax = input(' Enter the lower right Y-coords of field as: '); 
disp(' ’); 
dispC '); 

FSeries- 1'; 

FSeries=input('Which Field in this series (ie: "1", "2", "3",...? : ','s'); 
Foptions=[int2str(Process),BNt>pe,TNt>pe,Filtert>pe ? Choice,FSeries]; 
end; 
on=n; 
om=m; 

oXmin=Xmin; 

oYmin=Ymin; 

oXmax=Xmax; 

oYmax=Ymax; 

m_offset=0; 

n_offset=0; 

% if a local filter has been designated then the background is truncated to the region of concern 
if (Filtertype— L' | Filtertype=T) 

% set-up for local bkgd mean and stdev for each component, 
if keep_r='Y 

r=r(Y min-T m3 : Y max+T m3 ,Xmin-T n3 :Xmax+Tn3 ); 

[m,n]=size(r); 

end; 

if keep _g='Y 

g=g(Y min-Tm3 : Ymax+Tm3 ,Xmin-Tn3 :Xmax+Tn3); 

[m,n]=size(g); 

end; 

if keep_b='Y' 

b=b(Ymin-Tm3 : Ymax+Tm3 ,Xmin-Tn3 :Xmax+Tn3); 

[m,n]=size(b); 

end; 

% set the m & n offsets so that the original pixel row and col indices are kept intact 
m_offset=Y min-T m3 - 1 ; 
n_offs et =Xmin-T n 3 - 1 ; 
nn=round((n/2)-0.01); 
mm=round((m/2)-0.0 1); 

Xmin=Tn3+l; 

Xmax=n-Tn3; 

Ymin=Tm3+l; 

Ymax=m-Tm3; 

end; 



else % if [Pjoint is specified then use the image/target/options information 
% to determine if the [F]ield option for the same image/target/options 
% has been run since it will use the same filter coefficients used when 
% when the point within the specified field where evaluated. 
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disp(' '); 
dispC ’); 

disp('Point evaluations require the use of previously calculated'); 
disp('filter coefficients calculated from a field and stored as: '); 
Foptions=[int2str(Process),BNtype,TNtype,Filtertype,'F']; 
disp([Imagename,'_',Targetname,'_',Foptions, '?']); 
dispC '); 

FSeries=input('Which Field serial number (ie: "1", "2", "3",...)? : ','s'); 
dispC '); 
dispC '); 

disp('Checking for previously calculated Filter coefficients...'); 
dispC ’); 

Foptions=[Foptions,FSeries] ; 

Coeffile=[Imagename,'_',Targetname,'_',Foptions,'.coef]; 

[fid, message]=fopen(Coeffile,T','b'); 
if fid=-l 
disp('No luck... '); 
dispC '); 

disp('You MUST have run the Field Option to calculated filter coefficients...'); 
dispC '); 

disp('Hit ctrl-c and restart program...'); 
stop; 
else 

disp('Loading filter coefficients from:'); 
disp(Coeffile); 

Ilength=fread(fid,[ 1 ,2], 'short'); 

Sourcename=setstr(fread(fid,Ilength,'char')); 

Tlength=fread(fid,[l,2],'short'); 

T gtused=setstr(fread(fid,Tlength, 'char')) ; 

Flength=ff ead(fid, [ 1 ,2] ,'short'); 

Finfo=fread(fid,Flength,'char'); 
keep_r=setstr(fread(fid, [1 , l],'char')); 
keep_g=setstr(fread(fid. [1,1 ] ,’char')); 
keep_b=setstr(ff ead(fid, [1,1], 'char')) ; 
keep_C=setstr(fread(fid, [1,1 ] ,'char')) ; 
om=ff ead(fid, [1,1] ,'short'); 
on=fread(fid,[ 1 , l],'short'); 
oXmin=fread(fid,[ 1 , 1 ] ,'short'); 
o Y min=fread(fid, [1,1 ], 'short') ; 
oXmax=ffead(fid, [ 1 , 1 ], 'short'); 
o Y max=ff ead(fid, [1,1], 'short'); 
h_rgb_dim=ffead(fid, [ 1 ,2] ,'short') ; 
if keep_C='Y' 

h_123_dim=fread(fid,[l,2],'short'); 

end; 

if keep_r='Y' 

h_r=fread(fid, h_rgb_di m, 'float 64 ') ; 
if keep_C=*Y' 

hl=ffead(fid,h_l 23_dim,'float64'); 
end; 

r_mean=ff ead(fid,[ 1,1] ,'float64'); 
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r_std=fread(fid, [1,1 ],'float64'); 
end; 

if keep_g='Y' 

h _g=fread(fid,h_rgb_dim,'float64'); 
if keep_C=' Y' 

h2=fread(fid,h_l 23_dim.'float64'); 
end; 

g_mean=fread(fid, [1,1 ] ,'float64'); 
g_std=fread(fid,[l, l],'float64'); 
end; 

if keep_b='Y' 

h_b=fread(fid,h_rgb_dim,'float64'); 
if keep_C='Y' 

h3=fread(fid,h_123_dim,'float64’); 

end; 

b_mean=ffead(fid, [ 1 , 1 ],'float64'); 
b_std=fread(fid, [ 1 . 1 ],’float64'); 
end; 

fclose(fid); 

disp('These Coefficients created using :'); 

disp([Sourcename,' with targets ',Tgtused,' and filter options (',Finfo, ')']); 
end; 

while (Xmin<oXmin) | (Xmin>oXmax) | (Ymin<oYmin) | (Ymin>oYmax) 
disp(' '); 
disp(' '); 
skipX=l; 
skipY=l; 
dispC '); 

disp('***NOTE: X values must be between:'); 
dispC Min Max'); 

disp([Tn3+l, n-Tn3]); 

disp('***NOTE: Y values must be between:'); 
dispC Min Max'); 

disp([Tm3+l, m-Tm3]); 

Xmin=input(' Enter the x-coord for placing the target: '); 

Xmax=Xmin; 

Ymin=input(' Enter the y-coord for placing the target: '); 

Ymax=Ymin; 
dispC ’); 
dispC ’); 

PSeries=T; 

PSeries=input(' Which POINT in this series (ie: "1", "2", ”3",...)? : %'s’); 
Foptions=[int2str(Process),BNtype,TNtype,Filtertype,'P',PSeries]; 
end; 

if keep_r=' Y' 

r=r(Y min-Tm3 : Y max+T m3 ,Xmin-T n3 :Xmax+T n3); 

[m,n]=size(r); 

end; 

if keep_g='Y' 

g=g(Y min-Tm3 :' Ymax+Tm3,Xmin-Tn3 :Xmax+Tn3); 

[m,n]=size(g); 

end; 

if keep_b=' Y' 
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b-b(Y min-Tm3 : Y max+T m3 , Xmin-T n3 : Xmax+T n3 ) ; 
[ianl^sizefa); 
end; 

m_offset=Y min-Tm3 - 1 ; 
n_offset=Xmin-Tn3- 1 ; 
nn=Tn3+l; 
mm=Tm3+l; 

Xmin=Tn3+l; 

Xmax=Tn3+l; 

Ymin=Tm3+l; 

Ymax=Tm3+l; 

end; 
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APPENDIX D. M-FILE TO PREPROCESS IMAGES AND/OR TARGETS 



Filename: do_preprocessing.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa. in support of Master's Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 
% 

% This MATLAB m-file is a sub-program of "go_MCfilter". This code does 
% preprocessing if specified in the get_filter_info routine. The previously 
% specified preprocessing choices are stored in the variables BNtype and 
% TNtype. The preprocessing is normalization. 

% 

% 



bkgd_r=r; 

bkgd_g=g; 

bkgd_b=b; 

% Normalize Background and/or/nor the Target as specified 
if BNtype='N' | TNtype='N' 
if Choice='F' 
if keep_r='Y' 
r_mean=mean(r(:)); 
r_std=std(r(:)); 
end; 

ifkeep_g='Y' 

g_mean=mean(g(:)); 

g_std=std(g(:)); 

end; 

if keep_b='Y' 
b_mean=mean(b(: )); 
b_std=std(b(:)); 
end; 
end; 

% If specified. Normalize the Background first 
if BNtype='N' 
bkgd_r=[|; 
bkgd_g=[]; 
bkgd_b=[]; 
if keep_r='Y' 

UniformCheck=ab$(r - r_mean); 
if (mean(UniformCheck(:))) >= .01 
bkgd_r =(r - r_mean); 
if r_std~0 
bkgd_p=bkgd_r/r_std; 
end; 
else 

bkgd_r=r; 

dispC'bkgd^r...'); 

end; 
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end; 

if keep_g='Y' 

UmformCheck=abs( g - g_mean); 
if (mean(UniformCheck(:))) >= .01 
bkgd_g = ( g - g_mean); 
if g_std— 0 

bkgd_g=bkgd_g/g_std; 

end; 

else 

bkgd_g=g; 

disp( r bkgd_g=g...'); 

end; 

end; 

if keep_b='Y' 

UniformCheck=abs( b - bmean); 
if (mean(UniformCheck(:))) >= .01 
bkgd b = ( b - b mean) ; 
if b_std— 0 

bkgd_b=bkgd_b/b_std; 

end; 

else 

bkgd_b=b; 

dispCbkgd_b=b...'); 

end; 

end; 

end; 

% If Specified, Normalize the Target next, 
if TNtype='N' 
if keep_r='Y' 
tr=t_r-r_mean; 
if r_std~=0 
t_r=tr/r_std; 
end; 

tr=t_r .* (Tr_template=0); 
t_r=tr; 
clear tr; 
end; 

ifkeep_g='Y' 
tg=t _g-g_mean; 
if g_std~=0 
t_g=tg/g_std; 
end; 

tg=t_g .* (Tg_template=0); 
t_g=tg; 
clear tg; 
end; 

if keep_b='Y' 
tb=t_b-b_mean; 
if b_std~=0 
t_b=tb/b_std; 
end; 

tb=t_b .* (Tb_template=0); 
t_b=tb; 
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clear tb 
end; 
end; 

else % If not specified then assign standard values to be saved. 
r_mean=0; 
r_std=l; 
g_mean=0; 
g_std=l; 
b_mean=0; 
b_std=l; 

end; 

clear r g b UniformCheck 
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APPENDIX E. M-FILE TO DEVELOP MATCHED FILTER COEFICDENTS 



Filename: makeGLfilters.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master's Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 
% 

% 

% This M-file computes both 2-D spatial 3-D matched filter coefficients 
% (spatial-spectral) using the input background data and target model. 

% 

% 

% Uses: (other m-files) 

% choose_components.m 

% create_2D.m 

% create 3d.m 



starttime = clock; 
if Process=3 

r_equals_g = nnz(bkgd_r - bkgd _g) ~= 0; % 0 if red component equals green (1 otherwise) 
r_equals_b = nnz(bkgd_r - bkgd_b) ~= 0; % 0 if red component equals blue (1 otherwise) 
gequalsb = nnz(bkgd_g - bkgd_b) ~= 0, % 0 if green component equals blue (1 otherwise) 
redundant = r_equals_g + r_equals_b + g_equals_b; 
keep_r = 'Y'; 
keep_g = V; 
keep_b = W; 
keep_C = 'Y'; 
if redundant < 3 
msg='Y'; 

[keep_r,keep_g,keep_b]=choose_components(r_equals_g,r_equals_b,g_equals_b,msg); 

end; 

elseif Process=l 
keepjr = *Y'; 
keep_g = 'N'; 
keepb = 'N'; 
keep_C = 'N'; 
end; 

% PRODUCE 2-D HANNING WINDOW FOR USE IN BLURRING AND SMOOTHING 
disp(’ '); 
dispC '); 

disp('Checking for previously calculated harming window to match bkgd dimensions...'); 
dispC '); 

Hanfile=[int2str(m),'x',int2str(n),'.han’]; 

[fid, message]=fopen(Hanfile,'rVb'); 
if fid==-l 
dispC '); 

disp('No luck... must create new window. '); 
dispC '); 
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disp('Creating new Hanning Window...*); 
arravdimx = n; 
arraydimy = m; 
for k=l:m; 
for 1=1 :n; 

length =( (k-(arraydimy/2+.5)) A 2 + (l-(arraydimx/2+.5)) A 2 ) A 0.5; 
if length > arraydimy/2 
han(k,l) = 0; 
else 

han(kj) = ( cos( (pi/(1.0*m)) * length) ) A 2; 
end 
end 
end 

fid=fopen(Hanfile,'w', r b’); 

fvvrite(fid,han,'float64'); 

fclose(fid); 

else 

disp('LOADING 2-D HANNING WINDOW*); 
han=fread(fid, [ m, n] , *float64'); 
fclose(fid); 
end; 

target_r=[]; 

target_g=[]; 

target_b=[]; 

if keep_r='Y' 
target.r^erosCnun); 

target_r((mm-Tm2):(mm+Tm2),(nn-Tn2):(nn+Tn2)) = t_r; 
end 



if keep_g=' Y* 
target_g=zeros(m,n); 

target_g((nun-Tm2):(nun+Tm2),(nn-Tn2):(nn+Tn2)) = t_g; 
end 

ifkeep_b='Y* 
targ e t_b= z ero s (n i , n) ; 

target_b((nim-Tm2):(rnm+Tm2),(nn-Tn2):(nn+Tn2)) = t_b; 
end 

% CALCULATE 2-D MATCHED FILTER COEFFICIENTS FOR EACH BAND 
disp('CALCULATING 2-D MATCHED FILTER COEFFICIENTS FOR EACH BAND*) 



h_ r= []; 
h_g = []; 
h_b = []; 



if keep_r = V 
disp('start red:'); 
disp(clock); 

h_r=create_2D(target_r, bkgd_r, han. mm. nn, Tm3, Tn3); 
h_rgb_dim=size(h_r); 
end; 
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if keep_g = ' Y' 
dispCstart green:'); 
disp(clock); 

h_g=create_2D (targe t_g, bkgd_g, han, mm, nn, Tm3, Tn3); 
h_rgb_dim=size(h_g) ; 
end; 

if keep_b = 'Y' 
disp('start blue:*); 
disp(clock); 

h_b=create_2D(target_b, bkgd_b, han, mm, nn, Tm3, Tn3); 
h_rgb_dim=si ze(h_b) ; 
end; 

% CALCULATE 3-D MATCHED FILTER COEFFICIENTS 
if keep_C= , Y l 

dispOCALCULATING 3-D MATCHED FILTER COEFFICIENTS') 

[hl,h2,h3,h_123 jlim]=create_3d(target_r, target :_g, target_b, han, keep_r, keep_g, keep_b, bkgd_r, 
bkgd _g, bkgd_b, mm, nn, Tm3, Tn3); 
end; 

Coeffile=[Imagename,’_ , ,Targetname, , _ , ,Foptions, , .coef]; 

fid=fopen(Coeffile,’w', r b'); 

Ilength=size(Imagename) ; 

fvvrite(fid,Ilength,'short'); 

fwrite(fid,Imagename,'char'); 

Tlength=size(Targetname); 
fwrite(fid,Tlength,'short'); 
fwri te(fid,Targetname, 'char') ; 

Flength=size(Foptions); 
fv\Tite(fid,Flength,'short'); 
fwrite(fid,Foptions,'char’); 
fwrite(fid, keep_r, 'char') ; 
fwriteCfid^eepj^'char'); 
fwrite(fid,keep_b,'char'); 
fmite(fid,keep_C,'char’); 
fivrite(fid,om,'short'); 
fwrite(fid,on,’short’); 
fvvrite(fid,oXmin, 'short'); 
fwrite(fid, o Y min, 'short') ; 
fwri te(fid, oXmax, 'short'); 
fwrite(fid,oYmax,’short'); 
fwrite(fid, h_rgb_dim, 'short') ; 
if keep_C='Y' 
fwrite(fid,h_123_dim, 'short'); 
end; 

if keep_r='Y’ 
fwrite(fid,h_r,'float64'); 
if keep_C='Y' 
fwrite(fid,hl, 'float64'); 
end; 

fwrite(fid,r_mean,'float64'); 

f\\Tite(fid,r_std,'float64'); 
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end; 

if keep_g= Y' 
ftvTite(fi<th_g, , float64’); 
if keep_C=Y* 
fv\Ti te(fid, h2, 'float64 ') ; 
end; 

f\\Tite(fid,g_mean, , float64 , ); 

fwTite(fid,g_std, , float64 , ); 

end; 

if keep_b= Y’ 
fv\Tite(fid,h_b,'float64'); 
if keep_C=Y' 
ft\Tite(fid,h3,'float64’); 
end; 

fivri te(fid,b_mean, 'float64 ') ; 
ftvTite(fid,b_std,’float64'); 
end; 

fclose(fid); 

disp(start_time); 
end time = clock 
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M-file deriving 2-D matched filter coefficients. 

Filename: create_2D.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master's Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 
% 

% 

% This M-file function creates a 2-D matched filter which is slightly 
% larger than the original target (increased by twice the square-root of 
% the dimensions of the original target. 

% 

% 



[h_2D] = create_2D (target, bkgd, han, mm, nn, Tm3, Tn3) 

S = fft2(target); % converts the spatial target into spectral domain. 

West = abs(fft2(bkgd)). A 2; % produces the spectral power of the background noise. 

Rest = iffi2(West); % converts the background spectral power back into the spatial domain. 
R = Rest .* (fftshift(han)); % smoothes and averages the background noise. 

W = fft2(R); % converts "smoothed" background noise back into the spectral domain. 

H = WAconj(S); % convolves the inverted "smoothed" background noise with the target. 

h_2D = real(ifft2(H)); % converts this result into the spatial domain. 

h_2D = h_2D((mm+l-Tm3):(mm+l+Tm3),(nn+l-Tn3):(nn+l-HTn3)); % crops filter to size. 
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M-file deriving 3-D matched filter coefficients. 

Filename: create_3d.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogaw-a, in support of Master’s Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 

% 

% 

% This M-file function creates a 3-D matched filter which is slightly 
% larger than the original target (increased by twice the square-root of 
% the dimensions of the original target. Same technique as used in Create_2D.m 
% but carried out on the third (Spectral) dimension. 

% 

% uses: 

% fft3_9(...) 

% iffi3_9(...) 

% 

% 



function [hl,h2,h3,h_123_dim] = create_3d (target_r, target_g, target_b, han, keep_r, keep_g, keep_b, 
bkgd_r, bkgd_g, bkgd_b, mm, nn, Tm3, Tn3) 

disp('start target fit3: (step 1 of 5)’); 
disp(clock); 

[S 1 ,S2,S3 ]=fft3_9(target_r,target _g,target_b,keep_r,keep_g,keep_b); 

clear targe t_r target_g target_b; 
dispCstart bkgd fit3: (step 2 of 5)'); 
disp(clock); 

[BKGD_l,BKGD_2,BKGD_3]=fFt3_9(bkgd_r,bkgd_g,bkgd_b,keep_r,keep_g,keep_b); 

Westl=[]; 

West2=[]; 

West3=[]; 
if keep_r='Y' 

Westl=abs(BKGD_l). A 2; 

end; 

if keep_g='Y' 

West2=abs(BKGD_2). A 2; 

end; 

if keep_b=Y' 

West3=abs(BKGD_3). A 2; 

end; 

clear BKGD1 BKGD2 BKGD_3; 

disp('start REST 123 LSt3: (step 3 of 5)'); 
disp(clock); 

fRestl,Rest2,Rest3]=ifft3_9(Westl,West2,West3.keep_r,keep_g,keep_b); 

clear Westl West2 West3; 

Ri=[l; 

R2=[J; 

R3=n; 
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if keep_r='Y' 

Rl=Restl.*(ffishift(han))*l; 

end; 

if keep_g=' Y’ 

R2=Rest2.*(ffishift(han))*0; 

end; 

if keep_b=' Y' 

R3=Rest3.*(ffishift(han))*0; 

end; 

clear Restl Rest2 Rest3; 

disp('start W123 fft3: (step 4 of 5)'); 
disp(clock); 

[Wl,W2,W3]=£ft3_9(Rl,R2,R3,keep_r.keep _g,keep_b); 

clear R1 R2 R3; 

H1=D; 

H2=[]; 

H3=[]; 

if keep_r=' Y' 

Hl=Wl.\conj(Sl); 

end; 

if keep_g='Y’ & keep_b='Y' 

H3=W2.\conj(S2); % interchange of H2 and H3 compensates for 3D conjO 

H2=W3.\conj(S3); 
elseif keep_g='Y' & keep_b— N’ 

H2=W2.\conj(S2); 
elseif keep_g='N' & keep_b='Y' 

H3=W3.\conj(S3); 

end; 

clear W1 W2 W3 SI S2 S3; 

hi=D; 

h2=[]; 

h3=[]; 

disp('start hl23 ifft3: (step 5 of 5)'); 
disp(clock); 

[hl,h2,h3] = ifft3_9(Hl,H2,H3,keep_r,keep _g,keep_b); 

clear HI H2H3; 

if keep_r='Y' 

hi = real( hl((nun+l-Tm3):(mm+l+Tm3),(nn+l-Tn3):(nn+l+Tn3)) ); 
h_123_dim=size(h 1); 
end; 

if keep_g='Y' 

h2 = real( h2((nun+l-Tm3):(mm+l+Tm3),(nn+l-Tn3):(nn+l+Tn3)) ); 
h_123_dim=size(h2); 
end; 

if keep_b=' Y' 

h3 = real( h3((nun+l-Tm3):(nun+l+Tm3),(nn+l-Tn3):(nn+l+Tn3)) ); 
h_123_dim=size(h3); 
end; 
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APPENDIX F. M-FILE TO DEVELOP A TEMPLATE MATCHING FILTER 



Filename: make_Tfilters.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master's Degree Thesis work 
% September, 1 997, Nava] Postgraduate School 
% 

% 

% This M-file simply defines the necessary filters for Template 
% matching by using the targets themselves and "reversing" them for 
% the filters. 

% 

% 

% Uses: (other m-files) 

% choose_components.m 

% reverse, m 

% 

% 



start_time = clock; 
if keep_C='Y' 
if Process=3 

r_equals_g = nnz(bkgd_r - bkgd_g) — 0; % 0 if red component equals green (1 otherwise) 
r_equals_b = nnz(bkgd__r - bkgd_b) ~ 0; % 0 if red component equals blue (1 otherwise) 
g_equals_b = nnz(bkgd_g - bkgd_b) ~ 0; % 0 if green component equals blue (1 otherwise) 
redundant = r_equals_g + r_equals_b + g_equals_b; 
keeper = Y; 
keep_g = 'N'; 
keep J) = Y; 
keep_C = Y; 
if redundant < 3 
msg= , Y'; 

[keep_r,keep_g,keep_b]=choose_components(r_equals_g,r_equals__b,g_equals_b,msg); 

end; 

end; 

if keep_r='Y' 
h_r= reverse(t_r); 
h_rgb_dim-size(h_r) ; 
if keep_C =, Y' 
hl=h_r; 

h_123_dim=size(hl); 

end; 

end; 

if keep_g='Y' 
h_g= reverse(t__g); 
h_rgb_dim=size(h_g); 
if keep_C='Y' 
h2=h_g; 

h_ 1 23_dim=size(h2); 
end; 
end; 

if keep_b— Y' 
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h_b= reverse(t_b); 
h_r gb_di m=size(h_b) ; 
if keep_C=' Y' 
h3=h_b; 

h_ 1 23 _dim=size(h3 ); 
end; 
end; 
else 

keepjr - 'Y'; 
keep_g = 'N'; 
keep_b = 'N'; 
keep_C = ’N'; 
h_r= reverse(tjr); 
h_rgb_dim=size(h_r); 
h_template=(h_r=0); 
end; 

Coeffile=Pmagename,'_',Targetnaine,'J,Foptions,'.coef]; 

fid^openCCoeffileAv’,^'); 

Ilength=size(Imagename); 

fvvTite(fid,Ilength/short'); 

fv\Tite(fid,Imagename,'char’); 

Tlength=size(Targetname); 

fvvrite(fid,Tlength,'short’); 

fwrite(fid,Targetname,'char'); 

Flength=size(Foptions); 
f\vrite(fid,Flength, 'short'); 
f\vTite(fid,Foptions,'char'); 
fvvrite(fid,keep_r,'char'); 
ftvTite(fid,keep_g,'char’); 
fvvTite(fid,keep__b,'char'); 
fwrite(fid,keep_C,'char'); 
fwrite(fid, om, 'short') ; 
fwrite(fii on, 'short') ; 
fvvrite(fid,oXmin,'short'); 
fvvrite(fid, o Y min, 'short') ; 
fwrite(fid, oXmax, 'short') ; 
fvvrite(fid, o Y max, 'short') ; 
fwrite(fid, h_rgb_dim, 'short') ; 
if keep_C='Y’ 
fv\Tite(fid,h_123_dim,'short'); 
end; 

if keep_r='Y' 
fv\Tite(fid,h_r,'float64’); 
if keep_C='Y' 
fwTite(fid,h 1 ,'float64'); 
end; 

fvvrite(fid, r_mean,'float64') ; 
fv\Tite(fid,r_std,'float64’); 
end; 

if keep_g='Y' 
f\\rite(fid,h_g,’float64'); 
if keep_C='Y' 
fwrite(fid,h2,'float64'); 
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end; 

fv\Tite(fid,g_mean, , float64'); 

fvvTite(fid,g_std, , float64 , ); 

end; 

if keep_b='Y' 
fv\ri te (fid, h_b, 'float6 4 ') ; 
if keep_C= , Y' 
fvvTite(fid,h3, , float64’); 
end; 

fvvrite(fid,b_mean, 'float64') ; 
fwTite(fid,b_std,'float64 , ); 
end; 

fclose(fid); 
disp(start_time); 
end time-clock 



M-file to invert the target template. 



Filename: reverse.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master's Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 
% 

% 

% This M-file simply defines the necessary filters for Template 
% matching by using the targets themselves and "reversing" them for 
% the filters. 

% 

% 

function [RevFilter] = reverse (Filter) 

RevFiltei^Filter; 

[Ymax,Xmax]=size(Filter); 
for i=l:Ymax 
forj=l:Xmax 

RevFilter((Ymax+l)-i,(Xmax+l)-j)=Filter(ij); 

end; 

end; 
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APPENDIX G. M-FILE TO SEQUENTIALLY FILTER THE IMAGE 



Filename: filter_image.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master’s Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 
% 

% This MATLAB m-file is a sub-program of "go_MCfilter M . 

% 

% This M-file uses the matched filter coefficients (both 2-D spatial and 3-D 
% spatio-spectral) and performs sequential filtering operations by starting 
% from the top of the specified field (or the point coordinates) and evaluates 
% one point by convoluting the respective filter with the respective target 
% inserted at that point to get the "signal+noise" filter output value. 

% In order to get the "noise" output value of the specified background, the 
% respective filter is convolved with the entire background of interest and 
% stored. Thus, the noise for any specific point within the image is 
% efficiently calculated and paired to the "signal+noise" output value 
% corresponding to the point being evaluated. 

% 

% Uses: (other m-files) 

% filter_with_2D.m 

% filter_with_3D.m 

% 



timel=clock; 



dispCRunning matched filter across image field... '); 

disp('Started at time: '); 

clock 

% BEGIN DO-LOOPS WHICH CREATE SMALL IMAGE SEGMENTS AND PERFORM FILTERING 
clear summary summarys summaryn 

summary = []; summarys = []; summaiyn = []; % null matrix for later storing results 

scene_r=[]; scene_g=[]; scene_b=[]; 
if keep_i='Y* 

disp(Ted component setup...') 
clock 

noise_r=conv2 (bkgd_r,h_r, 'same') ; 
if keep_C='Y' 

dispCbonus 3rd-dim red component setup...'); 
clock 

noise_l=conv2(bkgd_r,h 1 ,'same'); 
end; 
end; 

if keep_g='Y' 

dispCgreen component setup...'); 
clock 

noise_g=conv2(bkgd_g, h_g, 'same') ; 
if keep_C='Y' 
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dispObonus 3rd -dim green component setup...'); 
clock 

noise_2=conv2(bkgd_g,h2,'same'); 

end; 

end; 

if keep_b='Y' 

dispCblue component setup...'); 
clock 

noise_b=conv2(bkgd_b,h_b,'same'); 

ifkeep_C=Y' 

dispCbonus 3rd-dim blue component setup...'); 
clock 

noise_3=conv2(bkgd_b,h3,'same'); 

end; 

end; 



ipos=G; 

jpos=G; 

Num=0; 

for i = Ymin:skipY:Ymax % locations of targets in y-direction 

disp(i+m_offset) 
disp(clock) 

for j = Xmin:skipX:Xmax % locations of targets in x-direction 
ipos=[ipos; i+m_offset]; 
jpos=[jpos; j+n_offset]; 

Num=Num+l; 

% FILTER LWTR SCENE (RED) USING 2-D SPATIAL FILTER 
fil_SNR_2dr = 0; 
fil_NNR_2dr = 0; 
if keep_r = ' Y' 

% disp('FILTERING LWIR SCENE (RED) USING 2-D SPATIAL FILTER’) 
fil_NNR_2dr=noise_r(ij); 

[fil_SNR_2dr, scene_r] = filter_w’ith_2D (i j, bkgd_r, h_r, t_r, mm, nn, Tm2, Tn2, Tm3, Tn3, 

Tr_template); 

end; 



% FILTER MWER SCENE (GREEN) USING 2-D SPATIAL FILTER 
fil_SNR_2dg = 0; 
fil_NNR_2dg = 0; 
if keep_g = 'Y' 

% di sp ('FILTERIN G MWIR SCENE (GREEN) USING 2-D SPATIAL FILTER') 

fil_NNR_2dg=noise_g(ij); 

[fil_SNR_2dg, scene_g] = filter_with_2D (i j, bkgd_g, h_g, t_g, mm, nn, Tm2, Tn2, Tm3, Tn3, 
Tg_template); 
end; 



% FILTER SWIR SCENE (BLUE) USING 2-D SPATIAL FILTER 
fil_SNR_2db = 0; 
fil_NNR_2db = 0; 



if keep_b = 'Y' 

% disp('FILTERING SWIR SCENE (BLUE) USING 2-D SPATIAL FILTER') 
fil_NNR_2db=noise_b(ij); 
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[fil_SNR_2db, scene_b] = filter_with_2D (i j, bkgd_b, h_b, t_b, mm, nn, Tm2, Tn 2, Tm3, Tn3, 
Tb_template); 
end; 



% FILTER COMPOSITE SCENE (COLOR) USING 3-D SPATIAL FILTER 
fil_SNR_3d=0; 
fil_NNR_3d=0; 
if keep_C='Y' 

% dispC’FILTERING COMPOSITE SCENE (COLOR) USING 3-D SPATIAL FILTER') 
fil_NNR_3d=0; 
if keep_r='Y' 

fil_NNR_3 d=fil_NNR_3 d+noise_r(i j) ; 
end; 

if keep_g='Y' 

fil_NNR_3 d=fil_NNR_3 d+noise_g(i j ) ; 
end; 

if keep_b='Y' 

fil_NNR_3 d=fil_NNR_3 d+noise_b(i j); 
end; 

% [fil_SNR_3d] = filter_with_3D (scene_r, scene b, scene_g, keeper, hi, h2, h3, Tm3, Tn3); 

[Hm Hn]=size(h_123_dim); 
output 1 =zeros(Hm,Hn) ; 
output2=zeros(Hm,Hn) ; 
output3 =zeros(Hm,Hn) ; 
if keep_r='Y' 

% disp('make outputl...'); 

outputl = conv2(hl,scene_r,'same'); % filtering 

fil_SNR_3d=fil_SNR_3d+outputl(Tm3+l,Tn3+l); % pt. of filter peak resonse - max signal 
end; 

if keep_g='Y' 

% disp('make output2...'); 

output2 = conv2(h2,scene_g,'same'); % filtering 

fil_SNR_3d=fil_SNR_3d+output2(lm3+l,Tn3+l); % pt. of filter peak resonse - max signal 
end; 

if keep_b='Y' 

% disp('make output3 . . .'); 

output3 = conv2(h3,scene_b, , same'); % filtering 

fil_SNR_3d=fil_SNR_3d+output3(Tm3+l,Tn3+l); % pt. of filter peak resonse - max signal 
end; 

clear outputl output2 output3 

end; 



% ADD SUMMARY DATA FOR CURRENT IMAGE SEGMENT 

summary’s = [ summary s ; fil_SNR_2dr fil_SNR_2dg fil_SNR_2db fil_SNR_3d]; 
summaryn = [summaryn ; fil_NNR_2dr fil_NNR_2dg fil_NNR_2db fil_NNR_3d]; 
index = l:l:Num; 

summary = [index’ summary’s summaryn ipos jpos]; 
end; 
end; 

summary 2 = summaiy ; 
save fdat8.mat summary2; 

Sum_dim=size(summary) ; 
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Datafile=[Imagename,'J,Targetaame,'J,Foptions,'.dat']; 
fid=fopen(Datafile, V , V) ; 

Ilength=size(Imagename) ; 
fvv^ite(ficlIlength, , sho^t , ); 
fwTite(fid ,Imagename,'char') ; 

Tlength=size(Targetname); 
fvvTite(fid,Tlength,'short’); 
fwTite(fid,Targetname,'char') ; 

Flength=size(Foptions); 

fwTite(fid,Flength,'short'); 

fwTite(fid,Foptions/char'); 

fwTite(fiikeep_r,'char'); 

fwTite(fid,keep_g, , char'); 

fvvTite(fid,keep_b,'char'); 

f\\Tite(fid,keep_C,'char'); 

f\\Tite(fid,om,'short'); 

fv\Tite(fi d,on, 'short') ; 

fwTite(fid,oXmin, 'short'); 

fwri te(fid, o Y min, 'short') ; 

fwrite(fid,oXma\,'short'); 

fwrite(fid,oYmax, 'short'); 

fwTite(fid,skipX,'short'); 

f\\Tite(fi&skipY,'short'); 

fwrite(fid, Sum_dim, 'short'); 

fvvii te(fid, summary, 'float64 ') ; 

fclose(fid); 

disp('Start time:'); 

disp(timel); 

time2=clock 
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M-file to filter with the 2-D filter at location (i,j). 

Filename: filter_with_2D.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master's Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 
% 

% This MATLAB m-file is a sub-program of "go_MCfilter M . This code uses the 
% given template to "cutout" the area in which the target is to be added to using 
% element by element multiplication and then matrix addition for "inserting" the 
% target into the area "cutout" for it. 

% 

% 

function [fil_SNR_2d, scene] = filter_with_2D (i, j, bkgd, h_2D, target, nun, nn, Tm2, Tn2, Tm3, Tn3, 
T_plate) 

scene = bkgd( (i-Tm3):(i+Tm3) , (j-Tn3):(j+Tn3) ); 

T_scene= scene((Tm3+l-Tm2):(Tm3+H-Tm2),(Tn3+l-Tn2):(Tn3+l+Tn2)); 

T_scene=(T_scene * T_plate) + target; 

scene((Tm3+l-Tm2):(Tm3+l+Tm2),(Tn3+l-Tn2):(Tn3+l+Tn2))=T_scene; 
output = conv2(h_2D,scene, , same'); % filtering 

fil_sig_max = output(Tm3+l,Tn3+l); % pt. of filter peak resonse - max signal 
fil_SNR_2d = fil_sig_max; 
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M-file to filter with the 3-D filters at location(ij). 



Filename: filterwithSD.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master's Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 
% 

% This MATLAB m-file is a sub-program of "go_MCfilter". This code uses the 
% given template to "cutout" the area in which the target is to be added to using 
% element by element multiplication and then matrix addition for "inserting" the 
% target into the area "cutout" for it. Done for up to three specified components. 

% 

% 

function [fil_SNR_3d] = filter_with_3D (scene_r, scene_b, scene_g, keeper, keep_g, keep_b, hi, h2, h3, 
Tm3, Tn3) 



[Hm Hn]=size(hl); 

Tm3 

output 1 =zeros(Hm,Hn); 
output2=zeros(Hm,Hn); 
output3=zeros(Hm,Hn); 
fil_sig_max=0; 
if keep_r='Y' 

% disp('make outputl...'); 

output 1 = conv2(hl,scene_r,'same'); % filtering 

fil_ s ig_ m ax=fil_ s ig_max+ o utput 1 (Tm3 + 1 ,Tn3+ 1); 
end; 

if keep_g='Y' 

% disp('make output2...'); 

output2 = conv2(h2,scene_g,'same'); % filtering 

fil_sig_ m ax=fil_sig_ m a x H-o u tput2(Tm3^ + 1 ,Tn3^ + 1 ) ; 
end; 

if keep_b='Y' 

% disp('make output3...'); 

output3 = conv2(h3,scene_b,'same'); % filtering 

fil_sig_ m ax=fil_sig_ m a\+ ou tput3 (Tm3 + 1 ,Tn3+ 1 ); 
end; 



% pt. of filter peak resonse - max signal 



% pt. of filter peak resonse - max signal 



% pt. of filter peak resonse - max signal 



clear outputl output2 output3 
fil_SNR_3d = fil_sig_max; % calc. SNR 
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APPENDIX H. M-FELE TO FILTER SEVERAL POSITIONS AT ONCE. 



Filename: conv_image.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master’s Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% 

% This MATLAB m-file is a sub-program of n go_MCfilter". 

% 

% This MATLAB m-file does the same filtering as the "filter_image" 

% routine but can make use of convoluting the entire background with several 
% targets inserted at several of the points to be evaluated. This alternate 
% method could save time if enough of the targets can be inserted into the 
% specified field and probably only in the case of the trunctated background. 
% 

% Uses: (other m-files) 

% make_COandADDIN.m 
% 



if keep_r=’Y' 

disp('red component setup...') 
clock 

Noise_r=conv2(bkgd_r,h_r,’same'); 
if keep_C='Y' 

dispCbonus 3rd-dim red component setup...’); 
clock 

Noise_l=conv2(bkgd_r,hl,’same'); 

end; 

end; 

if keep_g='Y 

disp('green component setup...'); 
clock 

Noise_g=conv2(bkgd_^,h_g,’same'); 
if keep_C='Y' 

dispCbonus 3rd-dim green component setup...’); 
clock 

Noise_2=conv2(bkgd_g,h2,'same’); 

end; 

end; 

if keep_b='Y’ 

dispCblue component setup...'); 
clock 

Noise_b=conv2(bkgd_b,h_b,’same’); 
if keep_C=’Y' 

dispCbonus 3rd-dim blue component setup...’); 
clock 

Noise_3=conv2(bkgd_b, h3 , 'same') ; 
end; 
end; 

fil_SNR_2dr= [] ; 
fil_SNR_2dg=[]; 
fil_SNR_2db=[]; 
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fil_SNR_3d=[]; 
fil_NNR_2dr=[]; 
fil_NNR_2dg= [] ; 
fil_NNR_2db=[]; 
fil_NNR_3d=[]; 



Yshift=skipY; 
if skipY>Tm4 
Yshift=skipY; 
end; 

Xshift=skipX; 
if skipX>Tn4 
Xshift=skipX; 
end; 

NeedNe\vCOandADDIN-Y'; 



ipos=[]; 

jpos=[]; 

Num=0; 

for inum=Yinin:Yshift:(Y min+Tm4) 
for jnimi=Xmin:Xshift:CXmin+Tn4^ 
disp([’Upper left target~> ('4nt2stt(iniim),7 ',int2str(jnumX')']); 
clock 

if NeedNewCOandADDIN=’Y' 
disp('Creating new Cutouts and Addins...'); 
clock 

if keep_r= , Y' 

[Cutout_r,Cm,Cn,Addin_r,X_pad,Y_pad]=make_COandADDrN 

(Tml,Tnl,Tm2,Tn2,Tm4,Tn4,Tr_template4_r,inum,jnum,Xmax,Ymax,skipX,skipY,m.n); 

end; 

if keep_g='Y' 

[Cutout^, Cm,Cn,Addin^Xjad,Yjad]^ake_COandADDIN 
(Tml,Tnl,Tm2,Tn2,Tm4,Tn4,Tg_template,t_g,inumJnum,Xmax,Ymax,skipX ? skipY,m,n); 
end; 

if keep_b='Y' 

[CutoutJ^Cn^C^AddinJ^Xja^YjadJ^ake^OandADDIN 

(Tml,Tnl,Tm2,Tn2,Tm4,Tn4,Tb_template,t_b,inumjnum,Xmax,Ymax,skipX,skipY,m,n); 

end; 

NeedNewCOandADDIN='N'; 

end; 

if ((inum-T m2+Cm)>m) | ((jnum-Tn2+Cn)>n) 

NeedNewCOandADDIN-Y'; 
disp('Need new Cutouts and Addins...'); 
else 

NeedNewCOandADDIN-N'; 

disp('Go with current Cutouts and Addins...'); 

Top=(inum-Tm2); 

Bottom=(inum-Tm2+Cm-l); 

Left=(jnum-Tn2); 

Right=(j num-Tn2+Cn- 1 ); 
end; 

if NeedNewCOandADDIN=='N' 
ifkeep_i=’Y' 
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disp('Convolving Targets in RED component (2D)...’); 
clock; 

Scene_r=bkgd_r; 

Scene_r(Top:Bottom > Left:Right)=Scene_r(Top:Bottom,Left:Right) .* Cutout_r + Adding; 
SN_r=conv2 ( Scene_r , h_r, ' same’) ; 
if keep_C=’Y' 

disp(’Convolving Targets in RED component (3D)...'); 
clock; 

SN_ 1 =conv2(Scene_r, h 1 /same’) ; 
end; 
end; 

if keep_g=’Y' 

disp('Convolving Targets in GREEN component (2D)...’); 
clock; 

Scene_g=bkgd _g; 

Scene_g(Top:Bottom,Left:Right)=Scene_g(Top:Bottom ? Left:Right) .* Cutout_g + Addin_g; 

SN_g=conv2(Scene_g,h_g,'same'); 

if keep_C='Y’ 

disp(' Convolving Targets in GREEN component (3D)...'); 
clock; 

SN_2=conv2(Scene_g,h2,'same'); 

end; 

end; 

if keep_b=’Y’ 

disp(’Convolving Targets in BLUE component (2D)...’); 
clock; 

Scene_b=bkgd_b; 

Scene_b(Top:Bottom,Left:Right)=Scene_b(Top:Bottom ? Left:Right) .* Cutout_b + Addin_b; 
SN_b=conv2(S cene_b, h_b, ’same’) ; 
if keep_C=’Y’ 

disp('Convolving Targets in BLUE component (3D)...'); 
clock; 

SN_3 =conv2 ( Scene_b , h3 , 'same') ; 
end; 
end; 
end; 

disp('Extracting results...’); 
clock 

for inum2=inum:Y_pad:Ymax 
for jnum2=jnum:X_pad:Xmax 
ipos=[ipos; inum2+m_offset]; 
jpos=|jpos; jnum2+n_offset]; 

Num=Num+l; 
if keep_r=’Y' 

fil_SNR_2dr=[fil_SNR_2dr; SN_r(inum2jnum2)]; 
fil_NNR_2dr=[fil_NNR_2dr; Noise_r(inum2 jnum2)]; 
else 

fil_SNR_2dr=[fil_SNR_2dr; 0]; 
fil_NNR_2dr=[fil_NNR_2dr; 0]; 
end; 

if keep_g='Y' 

fil_SNR_2dg=[fil_SNR_2dg; SN_g(inum2jnum2)]; 
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fll_NNR_2dg=[fil_NNR_2dg; Noise_g(inum2jnum2)]; 
else 

fil_SNR_2dg=[fil_SNR_2dg; 0]; 
fil_NNR_2dg=[fil_NNR_2dg; 0]; 
end; 

if keep_b='Y' 

fil_SNR_2db=[fil_SNR_2db; SN_b(inum2 j num2)] ; 
fil_NNR_2db=[fil_NNR_2db; Noise_b(inum2 jnum2)] ; 
else 

fil_SNR_2db=[fil_SNR_2db; 0]; 
fil_NNR_2db=[fil_NNR_2db; 0]; 
end; 

if keep_C='Y' 
fil_sig_ m ax=0; 
fil_null_max=0; 
if keep_r='Y' 

fil_sig_ m a\=fil_sig_max+SN_ 1 (inum2 j num2) ; 
fil_null_max=fil_null_max+Noise_ 1 (i num2 j niun2) ; 
end; 

if keep_g='Y' 

fil_sig_ m ax=fil_sig_ max +SN_2(inum2 jnum2); 
fil_null_max=fil_null_max+Noise_2(inuin2jniiin2) 
end; 

if keep_b='Y' 

fil_sig_niax=fil_ s ig_ m ax+SN_3 (inum2jnum2); 
fil_null_max=fil_null_max+Noise_3(inum2jnum2); 
end; 

fil_SNR_3 d= [fil_SNR_3 d; ffl_sig L max]; 
fil_NNR_3 d= [fil_NNR_3 d; fil_null_max]; 
else 

fil_SNR_2dr=[fil_SNR_2dr; 0]; 
fil_NNR_2dr=[fil_NNR_2dr; 0]; 
end; 
end; 
end; 

disp('done extracting results...'); 
clock 
end; 
end; 

index=l:l:Num; 

surrunaryS=[fil_SNR_2dr,fil_SNR_2dg,fil_SNR_2db > fil_SNR_3d]; 
summaiyN= [fil_NNR_2dr,fil_NNR_2dg,fil_NNR_2db,fil_NNR_3 d] ; 
summary=[index' summary S summarvN ipos jpos]; 
simiman2= summary; 
save fdat8.mat summary2; 

S um_dim=size(summary) ; 

Datafile=[Imagename, , _',Targetname,'_',Foptions,'.dat']; 

fid^openpatafile/w',^'); 

Ilength=size(Imagename); 

f\vrite(fidJlength/shoit'); 

fwrite(fid,Imagename,'char'); 

Tien gth=size(Targetname) ; 
fv\Tite(fid,Tlength,'short'); 
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f\vrite(fidTargetname,'char'); 
Flength=size(Foptions); 
ft\Tite(fid,Flength,'short’); 
f\\Tite(fid,Foptions,'char'); 
f\\Tite(fid, keeper, 'char'); 
fvvriteCfickkeep^/char'); 
f\YTite(fid,keep_b,'char’); 
f\\Tite(fid,keep_C,’char'); 
f\\Tite(fid,om, 'short'); 
fv\Tite(fid, on, 'short'); 
fwrite(fid,oXmin, 'short'); 
fv\Tite(fid,oYmin,'short'); 
f\\Tite(fid,oXmax, 'short'); 
fwrite(fid,oYmax, 'short'); 
fwrite(fid,skipX,'short'); 
fvvrite(fid,skipY, 'short'); 
fwrite(fid, Sum_dim,’short'); 
fwrite(fid, summary, 'float64'); 
fclose(fid); 

dispCFinished...'); 

clock 



M-file to create cutout and add-in patterns. 



Filename: make_COandADDIN.in 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master's Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% 

% This MATLAB m-file is a sub-program of "go_MCfilter". This code creates 
% a "pattern" of target cutouts and a corresponding "pattern" of targets which 
% is used in the same manner of a "single" cutout and add done in filter_with_2D 
% or 3D m-files. However, this "pattern" cuts-out and adds-in several targets 
% at once. 

% 

% 

function [Cutout,Cm,Cn,Addin,X_pad,Y_pad] = make_COandADDIN 
(Tml,Tnl,Tm2,Tn2,Tm4,Tn4,Tplate,Tgt,inumjnum,Xmax,Yma\,SkipX.SkipY,m,n) 

Cutout=[]; 

C01ine=[]; 

Addin=[]; 

AIline=[]; 

Y_pad=Tm4; 
if SkipY>Tm4 
Y_pad=SkipY; 
end; 

Y_COspacer=ones(Y _pad-Tml ,Tnl); 

Y_ADDINspacer=zeros(Y _pad-T m 1 ,Tn 1); 

X_pad=Tn4; 
if SkipX>Tn4 
X_pad=SkipX; 
end; 

for inum2=inum:Y_pad:Yma\ 
if (inum2+Tm2)<m 
C01ine=[C01ine; Tplate]; 

AIline=[AIline; Tgt]; 
if (inum2+Tm2+Y_pad)<m 
C01ine=[C01ine; YCOspacer]; 

AIline=[AIline; Y_ADDINspacer]; 
end; 
end; 
end; 

[COm, C0n]=size(C01ine); 

X_COspacer=ones(COm,X_pad-Tnl); 

X_ADDINspacer=zeros(COm,X_pad-Tn 1 ); 
for jnum2=jnum:X_pad:Xma\ 
if (jnum2+Tn2)<n 
Cutout=[Cutout, COline] ; 

Addin=[ Addin, Alline] ; 
if (jnum2+Tn2+X_pad)<n 
Cutout=[Cutout, X COspacer]; 

Addin=[ Addin, X_ADDINspacer]; 
end; 



126 



end; 

end; 

[Cm,Cn]=size(Cutout); 
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APPENDIX I. M-FILE TO DISPLAY RESULTS AS A ROC PLOT 



Filename: roc9,m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master's Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 
% 

% This MATLAB m-file is a sub-program of "go_MCfilter". 

% 

% This M-file takes the output results from the multicolor matched filter 
% processing (both 2-D spatial and 3-D spatio-spectral) and computes data for 
% the ROC plots. This information is then output to the screen and saved to a 
% file using the Imagename_Targetname_OPTIONS.roc filename which can be viewed 
% at a later time using "recall_roc9". 

% 

% uses: 

% Threshold, m 

% 

% 



[rows,cols] = size(summary); 
count = rows; 

sig_r = summary (:, 2); 
si g_g = summaiy(:,3); 
sig_b = summary(:,4); 
sig_c = summary(:,5); 

null_r = summaiy(:,6); 
null_g = summaiy(:,7); 
null_b = summaiy(:,8); 
null_c = summaiy(:,9); 

Fused=[]; 
result_r=0; 
if keep_r='Y' 

if mean(sig_r(:))<mean(null_r(:)) 
sig__r=-sig_r; 
null_r=-null_r; 
dispC ’); 
dispC '); 

STRmsg='NOTE!: "inverse" energy situation- data inverted'; 
if keep_C='Y' 

STRmsg=[STRmsg,' for RED component']; 

Fused=[Fused,'red ']; 
end; 

disp(STRmsg); 

end; 

% COMPUTE ROC-CURVE FOR LWIR (RED) TARGET AND BACKGROUND 
disp('COMPUTING ROC-CURVE FOR LWIR (RED) TARGET AND BACKGROUND') 
result_r = Threshold(sig_r, null_r, count); 
res_size=size(result_r); 
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end; 



clear result threshold sig null pmr far 



result_g=0; 
if keep_g='Y' 

if mean(sig_g(:))<mean(null_g(:)) 
sig_g=-sig_g; 
null_g=-null_g; 
dispC '); 
dispC '); 

STRmsg='NOTE!: "inverse" energy situation- data inverted'; 
if keep_C— Y' 

STRmsg=[STRmsg,' for GREEN component’]; 

Fused=[Fused,'green ']; 
end; 

disp(STRmsg); 

end; 

% COMPUTE ROC-CURVE FOR MWIR (GREEN) TARGET AND BACKGROUND 
di sp(' COMPUTIN G ROC-CURVE FOR MWIR (GREEN) TARGET AND BACKGROUND') 
result_g = Threshold(sig_g, null_g, count); 
res_size=size(result_g); 
end; 

clear result threshold sig null pmr far 

result_b=0; 
if keep_b='Y' 

if mean(sig_b(:))<mean(null_b(:)) 
sig_b=-sig_b; 
null_b=-null_b; 
dispC '); 
dispC '); 

STRmsg='NOTE!: "inverse" energy situation- data inverted'; 
if keep_C='Y' 

STRmsg=[STRmsg,' for BLUE component']; 

Fused=[Fused, r blue ']; 
end; 

disp(STRmsg); 

end; 

% COMPUTE ROC-CURVE FOR SWIR (BLUE) TARGET AND BACKGROUND 
di sp(' COMPUTIN G ROC-CURVE FOR SWIR (BLUE) TARGET AND BACKGROUND') 
result_b = Threshold(sig_b, null_b, count); 
res_size=size(result_b); 
end; 

clear result threshold sig null pmr far 

result_c=0; 
if keep_C— ’Y' 

if mean(sig_c(:))<mean(null_c(:)) 
sig_c=-sig_c; 
null_c=-null_c; 

dispC '); 
dispC '); 

STRmsg='NOTE!: "inverse" energy situation- data inverted'; 
if keep_C='Y' 

STRmsg=[STRmsg, , for FUSED(',Fused,') ']; 
end; 

disp(STRmsg); 
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end; 

% COMPUTE ROC-CURVE FOR COMPOSITE (COLOR) TARGET AND BACKGROUND 
disp(' COMPUTING ROC-CURVE FOR COMPOSITE (COLOR) TARGET AND BACKGROUND 1 ) 
result_c = Threshold(sig_c, null_c, count); 
res_size=size(result_c); 
end; 

clear result threshold sig null pmr far 

% PLOT RESULTS USING MATLAB GRAPHICS 
disp('PLOT RESULTS USING MATLAB GRAPHICS') 
figure; 

if keep_C='Y' & size(result_c)>[l,l] 
plot(resuIt_c(:,l),result_c(:,2),'y'); 
hold on; 
end; 

if keep_r='Y' & size(result_r)>[l,l] 
plot(result_r(:,l),result_r(:,2),'r:'); 
hold on; 
end; 

if keep__g='Y' & size(result_g)>[l,l] 
plot(resuIt_g(:,l),result_g(:,2),'g:'); 
hold on; 
end; 

if keep_b='Y' & size(result_b)>[l,l] 
plot(result_b(:,l),result_b(: ? 2), , b:'); 
hold on; 
end; 

ROCtitle=[ , Empirical ROC for 'Jmagename,' with ',Targetname,' (',Foptions,')']; 
title(ROCtitle); 

ylabel('probability of detection'); 
xlabel('false alarm rate'); 
axis([-.025, 1.025,-0.025, 1.025]) 
hold off; 

Resultsfile=[Imagename,'J,Targetname,'J,Foptions,'.roc']; 

fid^open^esultsfile/w',^'); 

Ilength=size(Imagename); 
ftvrite(fid,Ilength,'short'); 
fwrite(fid,Imagename,'char') ; 

Tlength=size(Targetname); 

fwrite(fid,Tlength,'short'); 

fwrite(fid,Targetname,'char'); 

Flength=size(Foptions) ; 
ftvrite(fid,Flength, 'short') ; 
fwrite(fid,Foptions,'char'); 

Iwrite(fid,keep_r, 'char') ; 
fwrite(fid,keep_g, 'char') ; 
fwrite(fi d,keep_b, 'char') ; 
fwrite(fid,keep_C,'char'); 
fwrite(fid,res_size,'short') ; 
if keep_r='Y' 
fwrite(fid, resul t_r, 'float64 ') ; 
end; 

if keep_g=' Y' 



131 



ftvrite(fid,result_g,'float64'); 

end; 

if keep_b='Y' 
fwri te(fi d, resul t_b, 'fl oat64') ; 
end; 

if keep_C=' Y' 
fvvrite(fid,resu]t_c,'£loat64'); 
end; 

fclose(fid); 
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M-file to vary the threshold criteria. 

Filename: Threshold.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by : James S. Ogawa, in support of Master's Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 
% 

% This MATLAB m-file is a sub-program of "go_MCfilter". This code varies 
% the threshold criteria from the maximum value down to the minimum value 
% (100 decriments) and calculates the associated Pd and Pfa at each threshold 
% criteria. 

% 

% 

function [result] = Threshold (sig,null, count) 
result=[]; 

maximum = max( [sig; null] ); 
minimum - min( [sig; null] ); 
if maximum <= minimum 

dispCPROBLEM OF MAX CLUTTER LEAKAGE ALWAYS < MIN SIGNAL’); 
end 

increment = (maximum - minimum) / 100; 
for threshold = (maximum+2*increment):-increment:minimum 
s_exceed = 0; 
n_exceed = 0; 

s_exceed = sig >= threshold; 
s_exceed = sum(s_exceed); 
n_exceed = null >= threshold; 
n_exceed = sum(n_exceed); 

pmd = 1 -((count - s_exceed) / count); % probability of detection 
far = n_exceed / count; % false alarm rate 

result = [result ; far pmd]; 
end 
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APPENDIX J. M-FILES TO DISPLAY DATA 



Filename: recall_roc9.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master's Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 

% 

% This MATLAB m-file is a sub-program of "go MCfilter". This code allows 
% you to redisplay any previously evaluated image target OPTIONS ROC plot by 
% recalling the stored information in the associated ".roc" file. No 
% recalculations are needed. 

% 

% 

fid=-l; 
while fid=-l 
disp(' '); 
dispO '); 

Results=input('Enter file with roc results (".roc" assumed): ','s'); 
Resultsfile=[Results,'.roc']; 
fid=fopen(Resultsfile,'r'); 
end; 

Ilength=ff ead(fid, [1,2] , 'short') ; 

Imagename=fread(fid,llength,'char'); 

Imagename=setstr(Imagename); 

Tlength=ffead(fid,[l,2],’short'); 

Targetname=ffead(fid,Tlength,'char'); 

Targetname=setstr(Targetname); 

Flength=ffead(fid, [ l,2],'short'); 

Foptions=fread(fid,Flength,'char'); 

Foptions=setstr(Foptions); 
keep_r=setstr(fread(fid, [ 1 , 1 ] ,'char')); 
keep_g=setstr (fread(fid, [1,1], 'char')) ; 
keep_b=setstr(fread(fid, [1,1], 'char')) ; 
keep_C=setstr(fread(fid, [1,1 ] ,'char')); 
res_size=ff ead(fid, [ 1 ,2] , 'short'); 
if keep_r='Y' 

result_r=ffead(fid,res_size,'float64'); 

end; 

if keep_g='Y' 

result_g=ffead(fid,res_size,'float64'); 

end; 

if keep_b='Y' 

result_b=fread(fid,res_size,'float64'); 

end; 

if keep_C='Y' 

result_c=ffead(fid,res_size,'float64'); 

end; 

fclose(fid); 

% PLOT RESULTS USING MATLAB GRAPHICS 
disp('PLOT RESULTS USING MATLAB GRAPHICS') 



135 



figure; 

if keep_C='Y' & size(result_c)>[l,l] 
plot(result_c ( : , 1 ), result_c( : , 2), y ) ; 
hold on; 
end; 

if keep_r='Y' & size(result_r)>[l,l] 
plot(result_r(:,l),result_r(:,2),'r:'); 
hold on; 
end; 

if keep_g='Y' & size(result_g)>[l,l] 
plot(result_g(:,l),result ;_g(:,2)/ g:'); 
hold on; 
end; 

if keep_b='Y' & size(result_b)>[l,l] 
plotCresultbC^lJjesul^bC:^),!):'); 
hold on; 
end; 

ROCtitle=['Empirical ROC for 'Jmagename,' with ',Targetname,' (',Foptions,')']; 
title(ROCtitle); 

vlabel('probability of detection'); 
xlabel('false alarm rate'); 
axis([-.025, 1 .025,-0.025, 1 .025]) 
hold off; 
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M-file to show the 2-D and 3-D filters. 



Filename: show_coefs.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master's Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 
% 

% This MATLAB m-file is a sub-program of "goMCfilter". This allows you to 
% graphically inspect the calculated 2-D and 3-D filters for any evaluated 
% image_target_OPTIONS.coef file. 

% 

% 

fid=-l; 
while fid=-l 
disp(' '); 
disp(' '); 

Coef=input('Enter the Coeficients FILE (".coef 1 assumed): 

Coeffile=[Coef,’.coef]; 
fid=fopen(CoefEile, 'r'); 
end; 

dispCLoading 2-D and 3-D matched filter coefficients from:'); 
disp(Coeffile); 

Ilength=fread(fid,[ l,2],'short'); 

Imagename=ffead(fid,Ilength,'char'); 

Imagename=setstr(Imagename); 

Tlength=fr eadffid, [ 1 ,2], 'short'); 

Targetname=ffead(fid,Tlength,'char'); 

Targetname=setstr(Targetname); 

Flength=ff ead(fid, [ 1 ,2] ,'short'); 

Foptions=fread(fid,Flength,'char'); 

Foptions=setstr(Foptions); 
keep_r=setstr(fread(fid, [1,1] ,'char')); 
keep_g=setstr(ffead(fid, [ 1, l],'char')); 
keep_b=setstr(ff ead(fid, [1,1] ,'char’)); 
keep_C=setstr(fread(fid,[ 1, l],'char')); 
m=ffead(fid, [ 1 , 1], 'short'); 
n=ffead(fid,[ 1, 1 ],'short'); 

Xmin=ffead(fid, [ 1 , 1 ],'short'); 

Y min=fread(fid, [1,1] ,'short'); 

Xmax=fread(fid, [1,1 ] ,'short'); 

Y max=ff eadffid, [ 1 , 1 ], 'short') ; 
h_rgb_dim=fread(fid, [ l,2],'short'); 
if keep_C='Y' 

h_l 23_dim=fread(fid, [ 1 ,2], 'short') ; 
end; 

if keep_r='Y' 

h_r=ffead(fid,h_rgb_dim,’float64'); 
if keep_C=’Y' 

hl=fread(fid,h_123_dim,'float64'); 

end; 

r_mean=fread(fid,[ 1, l],'float64'); 
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r_std=fr ead(fid, [1,1], 'float64'); 
end; 

if keep_g='Y' 

h_g=f^ead(fid,h_rgb_dim,'^loat64 , ); 
if keep_C='Y 1 

h2=fread(fid,h_123_diin,'float64'); 

end; 

g_mean=fread(fid,[ 1, l],'float64'); 
g_std=fr ead(fi& [1,1], , float64'); 
end; 

if keepb— Y' 

h_b=fread (fi cL h_rgb_dim, 'float64 ') ; 
if keep_C=Y’ 

h3 =firead(ficLh_ 1 23__dim, 'float64'); 
end; 

b_mean=fread(fid, [ 1 , 1 ],'float64'); 
b_std=fr ead (fid, [ 1 , 1 ] , 'float64 ') ; 
end; 

fclose(fid); 

SourceInfo=[Imagename,' with ',Targetname,' ('^options,')']; 
if keep_r='Y' 
figure; 

imshovvl(h_r); 

STRtitle=['2D filter for ’,SourceInfo]; 
if keep_C='Y' 

STRtitle=['RED(2D) filter for ',SourceInfo]; 
end; 

title(STRtitle); 
colormap(gray); 
if keep_C='Y' 
figure; 

imshowl(hl); 

STRtitle=['RED(3D) filter for ’,SourceInfo]; 
title(STRtitle); 
colormap(gray); 
end; 
end; 

if keep_g=’Y' 
figure; 

imshowl(h_g); 

STRtitle=['2D filter for \SourceInfo]; 
if keep_C— Y' 

STRtitle=[ , GREEN(2D) filter for \SourceInfo]; 
end; 

title(STRtitle); 
colormap(gray); 
if keep_C= , Y' 
figure; 

imshowl(h2); 

STRtitle=['GREEN(3D) filter for ',SourceInfo]; 
title(STRtitle); 
colonnap(gray); 
end; 
end; 
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if keep_b='Y' 
figure; 

imshowl(h_b); 

STRtitle=['2D filter for \SourceInfo]; 
if keep_C =, Y' 

STRtitle=[ , BLUE(2D) filter for ',SourceInfo]; 
end; 

title(STRtitle); 
colormap(gray); 
if keep_C =, Y' 
figure; 

imshowl(h3); 

STRtitIe=['BLUE(3D) filter for ',SourceInfo]; 
title(STRtitle); 
colormap(gray); 
end; 
end; 
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M-file to graphically display the data. 

Filename: display_data.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master’s Degree Thesis work 
% September, 1997. Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 

% 

% This MATLAB m-file is a sub-program of "go_MCfilter”. This allows you to 
% graphically inspect the data produced by the filter evaluation. It simply 
% recalls the actual data stored in the image_targer_OPTIONS.dat file and allows 
% you to see the histograms and/or the actual field of values for any specified 
% components that apply. 

% 

% 

disp(' '); 
dispO ’); 

Data=input('Enter name of the Datafile (”.dat" assumed): ','s'); 
dispC ’); 
dispC '); 

ShowDataPoints=input('Show data "field" information with histograms? (Y/N) : ','s*); 
Datafile= Pata, ' . dat’] ; 

Dfid=fopen(Datafile,'r'); 

Ilength=freadpfid, [ 1 ,2],'short'); 

Imagename=freadpfid,Ilength,’char'); 

Imagename=setstr(Imagename) ; 

Tlength=freadpfid, [ 1 , 2] ,'short') ; 

Targetname=freadpfid,Tlength, 'char') ; 

T argetname=setstr(Targetname) ; 

Flength=freadpfid, [ 1 ,2] , 'short'); 

Foptions=freadpfid,Flength,'char’); 

Foptions=setstr(Foptions); 
keep_r=setstr(freadpfid, [1,1 ],'char')); 
keep_g=setstr(freadpfid, [1,1 ] ,'char')) ; 
keep_b=setstr(freadpfid, [1,1], 'char')); 
keep_C=setstr(freadpfid, [1,1], 'char')) ; 
om=ffeadpfid, [1,1] ,'short') ; 
on=freadpfid, [ 1 , 1 ],'short'); 
oXmin=freadpfid, [ 1 , 1 ],'short'); 
o Ymin=freadpfid, [1,1 ], 'short') ; 
oXmax=freadpfid, [ 1 , 1 ], 'short') ; 
o Y max=freadPfid, [1,1 ] ,'short') ; 
skipX=freadpfid, [ 1 , 1 ],'short'); 
skipY =freadpfid, [1,1] ,’short’); 

Sum_dim=fread(Dfid, [ 1 ,2] ,'short') ; 

Fsummaiy=freadpfid,Sum_dim,'float64'); 

fclosepfid); 

disp(' '); 

disp(' '); 

disp('Data loaded for the following components:'); 

show_r=keep_r; 

show_g=keep_g; 
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show_b=keep_b; 
show_C=keep_C; 
if keep_r='Y' 
dispCRed '); 
show_r='*'; 
end; 

if keep_g='Y' 
disp('Green '); 
show_g='*'; 
end; 

if keep_b='Y' 
disp('Blue '); 
show_b='*'; 
end; 

if keepC— Y' 
disp(’Color '); 
show'C-*'; 
end; 
disp(' •); 
dispC '); 

disp('Specify which data to show:’); 
disp(’ ’); 
dispC •); 

while showr—Y’ & show_r~='N' 
show_r = input('RED ? ("Y" or "N") : ’/s’); 
end; 

while show_g~’Y' & show g—'N' 
showg = input(’GREEN ? ("Y" or M N") : ’/s'); 
end; 

while show_b~=’Y’ & show_b~='N' 
show_b = inputCBLUE ? ("Y" or M N M ) : ’/s'); 
end; 

while show_C~ Y' & show_C“'N' 
show C = input(’COLOR ? ("Y M or "N") : Vs'); 
end; 



SourceInfo=[Imagename,' with ^Targetname/^Foptions,')']; 

sig_r = Fsummaiy(:,2); 

sig_g = Fsmnmary(:,3); 

sig_b = Fsummary(:,4); 

sig_c = Fsummaiy(:,5); 

null_r = Fsummaiy(:,6); 

null_g = Fsummary(:,7); 

nullj) = Fsummary(:,8); 

null_c = Fsummary(:,9); 

RowIndex-Fsummaiy(:, 10); 

ColIndex=Fsummary(:, 11); 

Fu$ed=[]; 
if show_r='Y' 

maxX=abs(max([sig_r;null_r])); 

E=ceil(loglO(maxX)); 

Estr=int2str(E); 

Etxt=[]; 
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lEstr=length(Estr) ; 
for Epos=l:l:IEstr 
Etxt=[EL\t,' A, ,Estr(Epos)] ; 
end; 

sig_r=sig_r/( 1 0 A E) ; 
null_r=null_r/( 10 A E); 
if mean(sig_r)<mean(null_r) 
sig_r=-sig_r; 
null_r=-null_r; 
dispC '); 
dispC ’); 

STRmsg='NOTE!: "inverse” energy situation- data inverted’; 
if keep_C='Y' 

STRmsg=[STRmsg,' for RED component']; 
end; 

disp(STRmsg); 

end; 

if ShowDataPoints=='Y' 

SubOptNoise_r=sparse(RowIndex,ColIndex,null_r,om,on); 

SubOptSignal_r=sparse(Rowindex,ColIndex,sig_r,om,on); 

end; 

maxX=max([sig_r;null_r]); 
minX=min( [ sig_r ; null_r] ) ; 

Inc=(maxX-minX)/50; 

N=minX:Inc:ma\X; 

figure 

hist([null_r,sig_r],N) 

STRtitle=SourceInfo; 

STRxlabel=['2D Filter Output (xlO',Etxt,')']; 
if keep_C— 'Y' 

STRtitle=[STRtitle,' (RED component)']; 

STRxlabel=['RED component \STRxlabel]; 

Fused=[Fused,' red']; 
end; 

title(STRtitle); 
xlabel(STRxlabel); 
ylabelCNumber of Occurrences'); 
legend('Noise','Sig+Noise',0); 
if ShowDataPoints— Y' 

Zmin=min([null_r; sig_r; 0]); 
if Zmin<0 

Tplate=SubOptNoisej=0; 

Tplate=Tplate*Zmin; 

SubOptNoise_r=SubOptNoise_r+Tplate; 

Tplate=SubOptSignal_r=0; 

Tplate=Tplate*Zmin; 
SubOptSignal_r=SubOptSignal_r+Tplate; 
clear Tplate 
end; 

Zmax=max([null_r; sig_r; 0]); 
figure 

mesh(SubOptNoise_r) 
axis([l on 1 om Zmin Zmax]) 
axis ij 
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title(['Noise for \STRtitle]); 
ylabel('Image pixel row number'); 
xlabel('Image pixel column number'); 
zlabel(STRxlabel); 
figure 

mesh(SubOptSignal_r) 
a\is([l on 1 om Zinin Zmax]) 
axis ij 

title(['Signal+Noise for ’ ? STRtitle]); 
ylabel('Image pixel row number'); 
xlabel('Image pixel column number'); 
zlabel(STRxlabel); 
end; 
end; 

if show_g='Y' 

ma\X=abs(max( [sig_g; null_g] )) ; 

E=ceil(loglO(maxX)); 

Estr=int2str(E); 

Etxt=n; 

lEstr=length(Estr); 
for Epos=l:l:lEstr 
Etxt= [Etxt, ' A ' ,Estr (Epos) ] ; 
end; 

sig_g=sig_g/(10 A E); 
null_g=null_g/( 1 0 A E) ; 
if mean(sig_g)<mean(null_g) 
sig^g=-sig_g; 
null g=-null g; 

dispC ’); 

disp(' '); 

STRmsg='NOTE!: "inverse" energy situation- data inverted'; 
ifkeep_C=’Y' 

STRmsg=[STRmsg,' for GREEN component']; 
end; 

disp(STRmsg); 

end; 

if ShowDataPoints='Y' 

SubOptNoise_g=sparse(RowIndex,ColIndex,null_g,om,on); 

SubOptSignal_g=sparse(RowIndex,ColIndex,sig_g,om,on); 

end; 

Top=max([sig_g;null _g]); 

Bott=min( [sig_g;null_g] ) ; 

Inc=(Top-Bott)/50; 

N=Bott:Inc:Top; 

figure 

hist([null_g,sig_g],N) 

STRtitle=SourceInfo; 

STRxiabel=['2D Matched Filter Output (xlO',Etxt,')']; 
if keepC— Y' 

STRtitle=[STRtitle,' (GREEN component)']; 
STRxlabel=['GREEN component ',STRxlabel]; 
Fused=[Fused,' green']; 
end; 

title(STRtitle); 
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xlabel(STRxlabel); 
ylabel('Number of Occurrences’); 
legend(’NoiseVSig+Noise’,0); 
if ShowDataPoints— Y' 

Zmin=min([null_g; sig_g; 0]); 
if Zmin<0 

Tplate=SubOptNoise_g==0; 

Tplate=Tplate*Zmin; 

SubOptNoise_g=SubOptNoise_g+Tplate; 

Tplate=SubOptSignal_g=0; 

Tplate=Tplate*Zmin; 
SubOptSignal_g=SubOptSignal_g+Tplate; 
clear Tplate 
end; 

Zmax=max([null_g; sig_g; 0]); 
figure 

mesh(SubOptNoise_g) 
axis([l on 1 om Zmin Zmax]) 
axis ij 

title([’Noise for ’,STRtitle]); 
ylabel('Image pixel row number'); 
xlabel('Image pixel column number'); 
zlabel(STRxlabel); 
figure 

mesh(SubOptSignal_g) 
axis([l on 1 om Zmin Zmax]) 
axis ij 

title(['Signal+Noise for ’,STRtitle]); 
ylabel(’Image pixel row number’); 
xlabel('Image pixel column number'); 
zl abel ( STRxlabel) ; 
end; 
end; 

if show_b='Y' 

ma\X=abs(ma\([sig_b;null_b])); 

E=ceil(loglO(maxX)); 

Estr=int2str(E); 

Etxt=[]; 

lEstr=length(Estr); 
forEpos=l:l:lEstr 
Etxt=[Etxt,' A ',Estr(Epos)] ; 
end; 

1 ° A E); 

nulLb-null_b/(10 A E); 
if mean(sig_b)<mean(null_b) 
sig_b=-sig_b; 
null_b=-null_b; 

dispc ’); 
disp(' '); 

STRmsg='NOTE!: "inverse" energy situation- data inverted' 
if keep_C='Y' 

STRmsg=[STRmsg,' for BLUE component']; 
end; 

disp(STRmsg); 
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end; 

if ShowDataPoints='Y' 

SubOptNoiseJ)=sparse(RowIndex,ColIndex,nullJxom,on); 

SubOptSignal_b=sparse(RowIndex,ColIndex,sig_b,om,on); 

end; 

T op=max( [sig_b; null_b] ) ; 

Bott=min([sig_b;null_b]); 

Inc=(Top-Bott)/50; 

N=Bott:Inc:Top; 

figure 

hist([null_b,sig_b],N) 

STRtitle=SourceInfo; 

STRxlabel=['2D Matched Filter Output (xlO'JEtxt,')']; 
if keep_C='Y' 

STRtitle=[STRtitle,’ (BLUE component)’]; 
STRxlabel=['BLUE component ’,STRxlabel]; 
Fused=[Fused,' blue']; 
end; 

title(STRtitle); 
xlabel(STRxlabel); 
ylabel(’Number of Occurrences’); 
legend('Noise7Sig+Noise',0); 
if ShowDataPoints='Y' 

Zmin=min([null_b; sig_b; 0]); 
if Zmin<0 

Tplate=SubOptNoise_b=0; 

Tplate=Tplate*Zmin; 
SubOptNoise_b=SubOptNoise_b+Tplate; 
Tplate=SubOptSignal_b=0 ; 

Tplate=Tplate*Zmin; 

SubOptSignal_b=SubOptSi gnalJb+Tplate; 
clear Tplate 
end; 

Zmax-max([null_b; sig_b; 0]); 
figure 

mesh(SubOptNoise_b) 
axis([l on 1 om Zmin Zmax]) 
axis ij 

title(['Noise for ’,STRtitle]); 
ylabel(’Image pixel row number’); 
xlabel(’Image pixel column number'); 
zlabel( STRxlabel); 
figure 

mesh(SubOptSi gnalb) 
axis([l on 1 om Zmin Zmax]) 
axis ij 

title(['Signal+Noise for ’,STRtitle]); 
ylabel('Image pixel row number'); 
xlabel(’Image pixel column number'); 
zlabel(STRxlabel); 
end; 
end; 

if show_C=’Y' 

maxX=abs(max([sig_c;null_c])); 
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E=ceil(log 1 0(maxX)); 

Estr=int2str(E); 

Etxt=D; 

lEstr=length(Estr); 
for Epos=l:l:lEstr 
Etxt= [Etxt, ' A ’,Estr(Epos)] ; 
end; 

sig_c=sig_c/( 1 0 A E); 
nuH_c=null_c/( 1 0 A E); 
if mean(sig_c)<mean(null_c) 
sig_c=-sig_c; 
null_c=-null_c; 
dispC '); 
disp( f ’); 

STRmsg='NOTE!: ’'inverse'’ energy situation- data inverted'; 
if keep_C=‘Y’ 

STRmsg=[STRInsg, , for FUSED(',Fused,')']; 
end; 

disp(STRmsg); 

end; 

if ShowDataPoints— Y' 

SubOptNoise_C=sparse(RowIndexXolIndex,null_c,om,on); 

SubOptSignal_C=sparse(RowIndex,ColIndex,sig_c,om,on); 

end; 

Top=max([sig_c;nuIl_c]); 

Bott=min([sig_c;nuIl_c]); 

Inc=(Top-Bott)/50; 

N=Bott:Inc:Top; 

figure 

hist( [null_c, sig_c] ,N) 

STRtitle=SourceInfo; 

STRxlabel=['3D Matched Filter Output (xlO',Etxt,')']; 
if keep_C='Y' 

STRtitle=[ STRtitle, ' (FUSED',Fused/)']; 

STRxlabel= ['FUSED (',Fused,') ',STRxlabel]; 
end; 

title(STRtitle); 
xlabel(STRxlabel); 
ylabel('Number of Occurrences'); 
legend('Noise','Sig+Noise’,0); 
if ShowDataPoints='Y' 

Zmin=min([null_c; sig_c; 0]); 
if Zmin<0 

Tplate=SubOptNoise_C=0; 

Tplate=Tplate*Zmin; 

SubOp tNoise_C=SubOptNoise_C+Tplate; 
Tplate=SubOptSignal_C=0; 

Tplate=Tplate*Zmin; 

SubOptSignal_C=SubOptSignal_C+Tplate; 
clear Tplate 
end; 

Zmax=max([null_c; sig_c; 0]); 
figure 

mesh(SubOptNoise_C) 
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axis([l on 1 om ZminZmax]) 
axis ij 

title(['Noise for ’,STRtitle]); 
ylabel('Image pixel row number'); 
xlabel('Image pixel column number'); 
zlabel(STRxlabel); 
figure 

mesh(SubOptSignai_C) 
axis([l on 1 om ZminZmax]) 
axis ij 

Utle([’Signal+Noise for *,STRtitle]); 
ylabel('Image pixel row number’); 
xlabel(’Image pixel column number'); 
zlabel(STRxlabel); 
end; 
end; 



147 



M-file to calculate and display the sensitivities and bias. 

Filename: CalcSensAndBias.m 

% 

% SUBPROGRAM: MATLAB 5.0 m-files 

% Written by: James S. Ogawa, in support of Master's Degree Thesis work 
% September, 1997, Naval Postgraduate School 
% Base program supplied by: Dr. Dean Scribner, NRL 

% 

% This MATLAB m-file is a sub-program of "go_MCfilter". This code calculates 
% the associated Pd and Pfa for a data field and a point evaluation and outputs 
% the associated statistics and calculated sensitivity (d-prime) and response 
% bias (beta). 

% 

% uses: 

% Threshold_at_Pt.m 

% 

% 

disp("); 
dispC ’); 

disp(’Enter the file containing the FIELD Data (".dat" assumed): '); 
Fieldname=input(':: Vs'); 

Fieldfile= [Fieldname,’. dat'] ; 
disp(' '); 
disp(' '); 

disp('Enter the file containing the POINT Data (".dat" assumed): '); 
Pointname=input(':: Vs'); 

Pointfile=[Pointname, , .dat'] ; 

fid=fopen(Fieldfile,'r'); 

Ilength=fread(fid, [1,2] ,'short'); 

Imagename=fread (fid, Ilength, 'char') ; 

Imagename=setstr(Imagename) ; 

Tlength=fread(fid,[ 1,2], 'short'); 

Targetname=fread(fid,Tlength,'char'); 

T argetname=setstr (T argetname) ; 

Flength=fread(fid, [ 1,2], 'short'); 

Foptions=fi-ead(fid,Flength, 'char'); 

Foptions=setstr(Foptions); 
keep_r=setstr(fread(fid, [ 1, 1 ],’char’)); 
keep_g=setstr(fread(fid,[ 1 , l],'char')); 
keep_b=setstr(fread(fid,[ 1, l],'char')); 
keep_C=setstr(firead(fid, [1, l],'char')); 
om=fread(fid, [1,1 ] ,'short'); 
on=fread(fid, [ 1, 1], 'short'); 
oXmin=fread(fid, [1,1 ] ,'short'); 
oY min=fread(fid, [1,1 ] ,'short'); 
oXmax=fread(fid, [1,1 ] ,'short'); 
o Ymax=fread(fid, [1,1] ,'short'); 
skipX=fread(fid,[l, 1], 'short'); 
skipY=fread(fid,[ 1, 1], 'short'); 

Sum_dim=fread(fid,[ 1,2], 'short'); 

Fsummaiy=firead(fid, Sum_dim, ’float64’); 
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fclose(fid); 

[rows,cols] = size(Fsummary); 
count - rows; 

fid=€open(Pointfile,'r’); 

Ilength^eadCfid, [1,2] /short’); 
Imagename^ead(fidjlength,'char'); 
Imagename=setstr(Imagename); 
Tlength=fread(fid, [ 1,2], ’short'); 
Targetname=fread(fid,Tlength,'char’); 

T argetname=setstr(T argetname) ; 
Flength=fread(fid, [ 1 ,2] , ’short’) ; 
Foptions=fread(fid,Flength,'char'); 
Foptions=setstr(Foptions); 
keep_r=setstr(fread(fid, [1,1], ’char’)); 
keep_g=setstr(fread(fid, [ 1 , 1 ],’char')); 
keep_b=setstr(fread(fid,[ 1, l],'char’)); 
keep_C=setstr(fread(fid, [ 1, l],’char’)); 
om=fread(fid, [ 1, 1 ], 'short'); 
on=fTead(fid,[l, 1], ’short’); 
oXimn=fread(fid, [ 1, 1 ], 'short'); 
oY min^Fread (fid, [ 1 , 1 ] , 'short') ; 
oXmax=fread(fid, [1,1], 'short'); 
oY max=fread(fid, [1,1] ,'short '); 
skipX=fread(fid, [1,1], 'short'); 
skipY=fread(fid, [ 1, 1], 'short'); 
Sum_dim=fread(fi(l [1,2], 'short'); 
Psunrniaiy=fread(fid,Sum_dim,'float64'); 
fclose(fid); 

sig_r = Fsummaiy(:,2); 
sig_g = Fsummary(:,3); 
sig_b = Fsummaxy(:,4); 
sig_c = Fsummaiy(:,5); 

null_r = Fsummary(:,6); 
null_g = Fsummaiy(:,7); 
null_b = Fsummaiy(:,8); 
null_c = Fsummary(:,9); 

Tsig_r = Psummaiy(l,2); 

Tsig_g = Psummary(l,3); 

Tsig_b = Psummary(l,4); 

Tsig_c = Psummaiy(l,5); 

Tnull_r = Psummary(l,6); 

Tnull_g = Psiunmary(l,7); 

Tnull_b = Psummary(l,8); 

Tnull_c = Psummary(l,9); 

Dvector=[]; 

Bvector=[]; 

result_c=0; 
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if keep_C— Y' 

% COMPUTE SENSITIVITY, BIAS FOR (COLOR) 
dispC COMPUTIN G SENSITIVITY, BIAS FOR COMPOSITE (COLOR)’) 
if (mean(sig_c(:)) < mean(null_c(:))) 
s ig_ c =- s ig_ c ; % corrects for "inverse" energy situations 
null_c=-null_c; 

Tsig_c=-Tsig_c; 

T null_c=-Tnull_c; 
end; 

[Ph_c,Pfa_c,Dprime_c, Bias_c] = Threshold_at_Pt(sig_c, nullc, count, Tsig_c, Tnull_c); 
Dvector=[Dvector; Dprime_c]; 

Bvector=[Bvector; Bias_c]; 
end; 

result_r=0; 
if keep_r='Y' 

% COMPUTE SENSITIVITY, BIAS FOR (RED) 
disp(’COMPUTING SENSITIVITY, BIAS FOR (RED)’) 
if (mean(sig_r(:)) < mean(null_r(:))) 
sig r=-sig_r; % corrects for "inverse" energy situations 
null_r=-null_r; 

Tsig_r=-Tsig_r; 

T null_r=-T null_r; 
end; 

[Ph_r,Pfa_r,Dprime_r, Bias_r] = Threshold_at_Pt(sig_r, null_r, count, Tsig_r, Tnull_r); 
D\ f ector=[D\ r ector; Dprime r]; 

Bvector=[Bvector; Bias_r]; 
end; 

result_g=0; 
if keep_g='Y’ 

% COMPUTE SENSITIVITY, BIAS FOR (GREEN) 
disp(’COMPUTING SENSITIVITY, BIAS (GREEN)') 
if (mean(sig__g(:)) < mean(null_g(:))) 
sig_g=-sig_g; % corrects for "inverse" energy situations 
null_g=-null_g; 

Tsig_g=-Tsig_g; 

Tnull_g=-Tnull_g; 

end; 

[Ph_g,Pfa_g,Dprime_g, Bias_g] = Threshold_at_Pt(sig_g, null_g, count, Tsig_g, Tnull _g); 
D\ f ector=[Dvector; Dprime_g]; 

Bvector=[Bvector; Bias_g]; 
end; 

result_b=0; 
if keep_b=’Y’ 

% COMPUTE SENSITIVITY, BIAS FOR (BLUE) 
disp(’COMPUTING SENSITIVITY, BIAS FOR (BLUE)’) 
if (mean(sig_b(:)) < mean(null_b(:))) 
sig_b=-sig_b; % corrects for "inverse" energy situations 
null_b=-null_b; 

Tsig_b=-Tsig_b; 

T nu!l_b=-T null_b; 
end; 
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[Ph_b,Pfa_b,Dprime_b, Bias_b] = Threshold_at_Pt(sig_b, null_b, count, Tsig_b, Tnullb); 
Dvector=[Dvector; Dprimeb]; 

Bvector=[Bvector; Bias_b]; 
end; 

Dvector 

Bvector 
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APPENDIX K. S-PLUS FUNCTION TO PRODUCE SENSITIVITIES 



Filename: CalcSensAndBias (•) 

fiinction(TestData) 

{ 

# This function takes the formatted data results of 

# the human factors testing and computes each 

# individual’s sensitivity (d’) and bias (Beta) as well 

# as the overall sensitivity and bias per image class. 

# The data must be arranged into six columns in the 

# following order: [VI] Names, [V2] Sensor, [V3] Scene, 

# [V4] Position, [V5] Condition Shown, [V6] Subject’s 

# response. 

# This code evaluates the sensitivities by the number 

# of positions which the target was placed at. Thus, in 

# the case of three target positions, those scenes without 

# a target present will have to be matched to respective 

# target positions. Thus if the target was placed at 

# position "1”, ”2”, or ”3”, then the corresponding scenes 

# without a target could be labelled ”nl”, ’’n2", or "n3". 

# In any case, the code assumes that the first half of the 

# alphanumerically ordered ’’levels” in [V4] corresponds to 

# the various positions of the target, and the lower half 

# corresponding to the same scene shown without a target. 

# The conditions shown were "A” for a target present 

# in the image, and ”B” for no target present in the scene. 

# This code automatically adjusts for any number of 

# subjects, any number of scenes, as well as any number of 

# sensors, 
attach (TestData) 
trials <- length(Vl) 
classes <- c(levels(V2)) 
images <- c(levels(V3)) 
position <- c(levels(V4)) 

Xdim <- (length(images) * length(classes)) 

Xnames <- rep(”*”, Xdim) 

Iindex <- 0 

Cindex <- length (classes) 
repeat { 

Rangel <- (Iindex * length(classes)) + 1 
Range2 <- (Rangel + Cindex - 1) 

Xnames[Rangel:Range2] <- paste(images[Iindex + 1], classes) 
if(Iindex = length(images) - 1) 
break 

Iindex <- Iindex + 1 

} 

Names <- levels(Vl) 

Ynames <- c(Names, "overall”) 

Ydim <- length(Ynames) 

Zdim <- length(position) 

Zdim2 <- Zdim/2 
Znames <- position 
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Znames2 <- paste(position[l:Zdim2], position[(Zdim2 + l):Zdim]) 

ARinitl <- array(0, dim = c(Xdim, Ydim, Zdim), dimnames = list(Xnames, 

Ynames, Znames)) 

ARinit2 <- array(0, dim = c(Xdim, Ydim, Zdim/2), dimnames = list( 

Xnames, Ynames, Znames2)) 

AA <- ARinitl 
AJB <- ARinitl 
BB <- ARinitl 
BA <- ARinitl 
Ph <- ARinit2 
Pfa <- ARinit2 
QnormPh <- ARinit2 
QnormPfa <- ARinit2 
Dprime <- ARinit2 
DnormPh <- ARinit2 
DnormPFa <- ARinit2 
Bias <- ARinit2 
for(Pos in position) { 

cat("working segment ", Pos, " of {", paste(position), "}","\n") 
for(Im in images) 
for(Clss in classes) 
for(Nm in Names) { 

ImClss <- paste(Im, Clss) 

Select <- (V2 = Clss) * (V3 = Im) * (V4 = Pos) * (VI = Nm) 

AA [ImClss, Nm, Pos] <- sum(Select * (V5 = "A") * (V6 = "A")) 

AA[ImClss, "overall", Pos] <- AAflmClss, "overall", Pos] + AA[ImClss, Nm, Pos] 

AB [ImClss, Nm, Pos] <- sum(Select * (V5 = "A") * (V6 = "B")) 

AB[ImClss, "overall", Pos] <- ABflmClss, "overall", Pos] + ABflmClss, Nm, Pos] 

BB [ImClss, Nm, Pos] <- sum(Select * (V5 = "B") * (V6 = "B")) 

BB[ImClss, "overall", Pos] <- BB[ImClss, "overall", Pos] + BB[ImClss, Nm, Pos] 

BA [ImClss, Nm, Pos] <- sum(Select * (V5 = "B") * (V6 = "A")) 

BA [ImClss, "overall", Pos] <-BA[ImClss, "overall", Pos] + BA[ImClss, Nm, Pos] 

} 

} 

detach(2) 

ALLtotals <- AA + AB + BB + BA 
Element <- ALLtotals [1, 1,1] 

Ph <- (1/Element) * AA[, , (l:Zdim2)] 

Ph[, "overall", ] <- Ph[, "overall", ]/(Ydim - 1) 

Pfa <- (1/Element) * BA[, , ((Zdim2 + l):Zdim)] 

Pfa[, "overall", ]<- Pfa[, "overall", ]/(Ydim-l) 

AdjOnes <- (Ph = 1) * (0.01) 

Ph <- Ph - AdjOnes 
AdjZeros <- (Ph == 0) * (0.01) 

Ph <- Ph + AdjZeros 
AdjOnes <- (Pfa = 1) * (0.01) 

Pfa <- Pfa - AdjOnes 
AdjZeros <- (Pfa = 0) * (0.01) 

Pfa <- Pfa + AdjZeros 

QnormPh <- array(qnorm(Ph), dim = c(Xdim, Ydim, Zdim/2), dimnames= list(Xnames, Ynames, 
Znames2)) 

QnormPfa <- array(qnorm(Pfa), dim = c(Xdim, Ydim, Zdim/2), dimnames = list(Xnames, Ynames, 
Znames2)) 

Dprime <- QnormPh - QnormPfa 
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DnormPh <- array(dnorm(Ph), dim = c(Xdim, Ydim, Zdim/2), dimnames = list(Xnames, Ynames, 
Znames2)) 

DnormPfa <- array (dnorm (Pfa), dim = c(Xdim, Ydim, Zdim/2), dimnames = list(Xnames, Ynames, 
Znames2)) 

Bias <- (PnormPh/DnormPfa) 

list(BB = BB, BA = BA, AA = AA, AB = AB, Dprime = Dprime, Bias = Bias, Ph = Ph, Pfa = Pfa, 
QnormPh = QnormPh, QnormPfa = QnormPfa, DnormPh = DnormPh, DnormPfa = DnormPfa) 

} 
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APPENDIX L. C++ PROGRAM FOR SPECTRAL REWEIGHTING 



Filename: FFT.C 

#include <math.h> 

#include <stdio.h> 

#include <stdlib.h> 

#include "imgio.c" 

#include "fourl.c" 

#include "miscfops.c" 

#define MAX_XSIZE 1024 
#define MAX_YSIZE 1024 

/AVARNTNG: ALWAYS keep MAX_XSIZE bigger than or equal to MAX_YSIZE 

//Real dimensions of image 
int xsize; 
int ysize; 

//original and transformed images 
float orig_i mage [MAX_Y SIZE] [MAX_XSIZE] ; 
float real image [MAX Y SIZE] [MAX_XSIZE] ; 
float imag_image[MAX_YSIZE]fMAX_XSIZE]; 
float mag_image[MAX_YSIZE] [MAX_XSIZE] ; 
float phase_image [MAX_YSIZE] [MAX_XSIZE] ; 

float xarray[2*MAX_XSIZE]; 
float yarray[2*MAX_YSIZE]; 

float magnitude[MAX_XSIZE]; 
float logmag[MAX_XSIZE]; 
float logfreq[MAX_XSIZE]; 
int freqcoimt[MAX_XSIZE]; 

void main(int argc, char **argv) { 

int lw_xsize, lw_jsize; 

//variables in for loops 
int j; 

//computed parameters of input image 

float a,b; //linear regression coefficients 

float luminance; 

float contrast; 

float power; 

int cutoff; 

int thresh; 

float noise; 

//Input and output files 
FILE *f, *g; 



157 



mt err=0; 



int invplot = 0; // when invplot=l, the inverse flit is computed. 

if ( ! (f=fopen(argv[ 1], "rb"))) { 

fprintf(stderr, "Could not open input file\n"); 
exit(l); 

} 

if (!(g=fopen(argv[2]/ , wb”))) { 
fprintf(stderr,"Could not open output file\n"); 
exit(l); 

} 

read_and_normalize_pbm_image(f, orig_image, &lw_xsize, &hv_ysize, &err); 
xsize=lw_xsize; ysize=lw_ysize; 
copy_image(orig_image,real_image,xsize,ysize); 

spat_stat_image(real_image, &luminance, &contrast, xsize, ysize); //spatial statistics 

clear_image(imag_image,xsize,ysize); 

rearrange_image(real_image, xsize, ysize); 

//FFT along x-direction 
fprintf(stderr, "\nFFT X:\n"); 
for G = 0j<ysize-j-H-) { 

in_array(real_image, imag_image, xarray, xsize, j, ’x’); 
fft(xarray-l, xsize, 1); 

out_array(real_image,imag_image, xarrav, xsize, j, Y); 

} 

scale_image(real_image,(float)xsize, xsize, ysize); 
scale_image(imag_image,(float)xsize, xsize,ysize); 

//END 

//FFT along v-direction 
iprintf(stderr, M \n\nFFT Y:\n"); 
for (j = 0'j<xsize*j++) { 

in_array(real_image, imag_image, yarray, ysize, j, V); 
fft(yarray- 1, ysize, 1); 

out_array (real_i mage, i mag_image , yarray, ysize J, 'y'); 

} 

scale Jmage(real_image,(float)ysize, xsize, ysize); 
scale_image(imag_image,(float)ysize, xsize, ysize); 

//convert to polar coordinates 
clear_image(mag_image, xsize, ysize); 
clear_image(phase_image, xsize, ysize); 

polar_image(real_image, imag_image, mag_image, phase_image, xsize, ysize); 
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//Compute frequency based image statistics here 

rad_ffeq_image(mag_image, magnitude, freqcount, &cutoff, xsize, ysize); //compute image 

magnitudes as function of distance 
//thresh=cutoff; 

fprintf(stderr, "Enter threshold:"); 
scanf("%d",&thresh); 

lin_reg_image(magnitude, freqcount, thresh, cutoff, & a, &b, logfreq, logmag, &power, &noise); 
//Linear regression cutoffs 100 (second argument passed) 

//Write eveiything to a file 

fprintf(stderr,"a=%fb=%f lum=%f contr=%f pow=%f noise=%f\n", 
a,b,luminance,contrast,power,10e6*noise); 

\vrite2file(luminance, contrast, power, noise, a, b, logfreq, logmag, cutoff); 

if (in\plot=l) { 

//convert back to cartesian coordinates 
clear_image(real_image, xsize, ysize); 
clear_image(imag_image, xsize, ysize); 

cartesian_image(mag_image, phase_image, real_image, imag_image, xsize, ysize); 

^******♦*****^£1) ONLY FOR INVERSE FFT ********** 

//Inverse FFT along x-direction 
fprintf(stderr,"\nInvFFT X:\n"); 
for (j=0;j<ysizej++) { 

in_array(real_image, imag_image, xarray, xsize, j, Y); 
fift(xarray-l, xsize, -1); 

out_array(real_image,imag_image, xarray, xsize, j, Y); 

} 

//END 

//Inverse FFT along y-direction 
fprintf(stderr,"\nInvFFT Y:\n"); 
for (j=0 J<xsize*j-H-) { 

in_array(real_image, imag_image, yarray, ysize, j, Y); 
fit (yarray- 1 ,y size, - 1 ) ; 

out_array(real_image,imag_image, yarray, ysize, j, V); 

} 

//END 

rearrange_image(real_image,xsize, ysize); 
limit_pixvals_image(real_image, xsize, ysize); 

write_and_denormalize_pgm_image(g, real_image, xsize, ysize, 0); //change to pnm after debugging 
fclose(g); 

} //end of if invplot= 1 

fclose(f); 

exit(0); 



} 
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APPENDIX M. C++ PROGRAM TO SPLIT IMAGES INTO RGB IMAGES 



Filename: SPLITRGB.C 

#include <math.h> 

^include <stdio.h> 

#include "imgio.c" 

#define MAX_XSIZE 1024 
#define MAX_YSIZE 1024 

//Real dimensions of image 
int xsize, ysize; 

float min_tim e , max_ti me 4 nc_time ; //Not required in this program 

//original and transformed images 
float image_red[MAX_ YSIZE] [MAX_XSIZE] ; 
float image_green [MAX_YSIZE] [MAX_XSIZE] ; 
float image_blue|MAX_YSIZE] [MAX_XSIZE] ; 

void main(int argc, char **argv) { 

//Input and output files 
FILE *f, *r, *g, *b; 

int err=0; 

if ( ! (f=fopen(argv[ 1 ] , "rb"))) { 
fprintf(stderr, "Could not open input file\n”); 
exit(l); 

} 

if (!(r=fopen(argv[2], , Vb , ‘))) { 
fprintf(stderr, "Could not open output RED file\n"); 
exit(l); 

} 

if ( ! (g=fopen(argv[3 ] , ”wb”))) { 
fprintf(stderr, "Could not open output BLUE file\n"); 
exit(l); 

} 

if (!(b=fopen(argv[4],’’wb"))) { 
fprintf(stderr, "Could not open output GREEN file\n’’); 
exit(l); 

} 

read_and_normalize_ppm_image(f, image_blue, image_red, image_green, &xsize, &ysize, &err); 
//BUG! ! ! COME DEBUG LATER! 

fprintf(stdeir, "Dimensions of image: Width(X)=%d Height(X) = %d\n",xsize, ysize); 

write_and_denormalize_pnm_image(r, image_red, xsize, ysize, 0); 
write_and_denormalize_pnm_image(g, image_green, xsize, ysize, 0); 
write_and_denormalize_pnm_image(b, image_blue, xsize, ysize, 0); 
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fclose(f); 

fclose(r); 

fclose(g); 

fclose(b); 

exit(O); 

} 
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APPENDIX N. COLLECTED DATA 

“Rectangle” (IL) with Global matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Rectangle” (EL) with Local matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Rectangle” (EL) with Template matching filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Cylindrical Tank” (XL) with Global matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Cylindrical Tank” (EL) with Local matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Cylindrical Tank” (IL) with Template matching filter’s noise data, signal+noise 
data, histogram, and treshold critera for each of the target positions. 
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“Tower” (EL) with Global matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Tower” (IL) with Local matched filter’s noise data, signal+noise data, histogram, 
and treshold critera for each of the target positions. 
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“Tower” (EL) with Template matching filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Rectangle” (ER) with Global matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Rectangle” (ER) with Local matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Rectangle” (IR) with Template matching filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Cylindrical Tank” (IR) with Global matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Cylindrical Tank” (IR) with Local matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Cylindrical Tank” (IR) with Template matching filter’s noise data, signal+noise 
data, histogram, and treshold critera for each of the target positions. 
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“Tower” (ER.) with Global matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Tower” (IR) with Local matched filter’s noise data, signal+noise data, histogram, 
and treshold critera for each of the target positions. 





179 



“Tower” (IR) with Template matching filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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‘'Rectangle” (F2) with Global matched filter’s noise data, signal+noise data, 
histogr am, and treshold critera for each of the target positions. 
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“Rectangle” (F2) with Local matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Rectangle” (F2) with Template matching filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Cylindrical Tank” (F2) with Global matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Cylindrical Tank” (F2) with Local matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Cylindrical Tank” (F2) with Template matching filter’s noise data, signal+noise 
data, histogram, and treshold critera for each of the target positions. 
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“Tower” (F2) with Global matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Tower” (F2) with Local matched filter’s noise data, signal+noise data, histogram, 
and treshold critera for each of the target positions. 
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“Tower” (F2) with Template matching filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Rectangle” (FI) with Global matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Rectangle” (FI) with Local matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Rectangle” (FI) with Template matching filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Cylindrical Tank” (FI) with Global matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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Number of Occurrences 1 i 



“Cylindrical Tank” (FI) with Local matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Cylindrical Tank” (FI) with Template matching filter’s noise data, signal+noise 
data, histogram, and treshold critera for each of the target positions. 
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“Tower” (FI) with Global matched filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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“Tower” (FI) with Local matched filter’s noise data, signal+noise data, histogram, 
and treshold critera for each of the target positions. 
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“Tower” (FI) with Template matching filter’s noise data, signal+noise data, 
histogram, and treshold critera for each of the target positions. 
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APPENDIX O. EMPRIRCALLY DERIVED ROC PLOTS 
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APPENDIX P. RESPONSE BIAS SUMMARY FOR EACH FILTER 
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Local Template 


Human 


FI 


ret 


1 


0.626 


0.9259 


0.6126 


0.62016 


F2 


ret 


1 


0.677 


0.6552 


0.6126 


0.62016 


IR 


ret 


1 


0.6126 


0.6172 


0.6126 


0.62016 


IL 


ret 


1 


0.7138 


0.6648 


0.7215 


0.621386 


FI 


tnk 


1 


0.6126 


0.6126 


0.6126 


0.612626 


F2 


tnk 


1 


0.6168 


0.6126 


0.6127 


0.612747 


IR 


tnk 


1 


0.6126 


0.6126 


0.6126 


0.612747 


IL 


tnk 


1 


0.6185 


0.8824 


0.6726 


0.613201 


FI 


twr 


1 


0.682 


0.7378 


0.6126 


0.620038 


F2 


twr 


1 


0.6129 


0.6667 


0.6126 


0.620038 


IR 


twr 


1 


0.7604 


0.7337 


0.6133 


0.739722 


IL 


twr 


1 


0.6281 


0.7176 


0.6126 


0.620038 


FI 


ret 


2 


0.7638 


0.6676 


0.6126 


0.620038 


F2 


ret 


2 


0.7048 


0.6392 


0.6126 


0.686942 


IR 


ret 


2 


0.6126 


0.6126 


0.6126 


0.620038 


IL 


ret 


2 


0.826 


0.7031 


0.7029 


0.673672 


FI 


tnk 


2 


0.6126 


0.6126 


0.6126 


0.612626 


F2 


tnk 


2 


0.6126 


0.6126 


0.6127 


0.612626 


IR 


tnk 


2 


0.6126 


0.6126 


0.6126 


0.612626 


IL 


tnk 


2 


0.6321 


0.8941 


0.6541 


0.612626 


FI 


twr 


2 


0.6126 


0.6608 


0.6126 


0.620038 


F2 


twr 


2 


0.6234 


0.615 


0.6126 


0.620038 


IR 


twr 


2 


0.8301 


0.6904 


0.6133 


0.612626 


IL 


twr 


2 


0.6281 


0.6542 


0.6126 


0.612626 


FI 


ret 


3 


0.7229 


0.6427 


0.6126 


0.612626 


F2 


ret 


3 


0.6769 


0.6514 


0.6126 


0.62016 


IR 


ret 


3 


0.6126 


0.6126 


0.6126 


0.612626 


IL 


ret 


3 


0.7536 


0.6835 


0.7153 


0.633501 


FI 


tnk 


3 


0.6126 


0.6126 


0.6126 


0.612626 


F2 


tnk 


3 


0.6222 


0.6126 


0.6127 


0.612626 


IR 


tnk 


3 


0.6126 


0.6126 


0.6126 


0.620038 


IL 


tnk 


3 


0.7251 


0.9257 


0.6316 


0.620038 


FI 


twr 


3 


0.6271 


0.6258 


0.6126 


0.612626 


F2 


twr 


3 


0.6169 


0.6639 


0.6126 


0.612626 


IR 


twr 


3 


0.8298 


0.6283 


0.6133 


0.620038 


IL 


twr 


3 


0.6365 


0.644 


0.6126 


0.612626 



Table PI. This table summarizes the response biases for the global and local matched 
filters, the response biases for the template matching filter, and the averaged results of 
the subjects participating in the human factors experiment (Sampson, 1996). For 
example, the last line in this table shows the response biases found for the IL tower scene 
with the target placed at position three. 
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APPENDIX Q. ROC PLOTS OF SENSITIVITY RESULTS 
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APPENDIX R, MATLAB FUNCTION FOR CENSORED REGRESSION 



filename: Censored RegrssnMLEs.m 

function [Coefs, StdDev, CovMatrx] = CensoredRegrssnMLEs (X, Y, 
InitCoefs, InitStdDev, a, Tol , ShowCalc) 

% “X” contains columns of the independent variable- a column of ones is 

used for 

%■ if an intercept coefficient is desired. 

%• “Y” is a column of the response variable. 

% “InitCoefs” is a column of the estimated coefficient values in the 
order of 

% the columns of “X” (A good start are the coefficient estimates from 
OLS) . 

%■ “InitStdDev” a scalar estimate of the standard deviation. 

%■ “a” is the censored value (for centered from above) . 

% “Tol” is the error tolerance for terminating Newton's Method. 

% “ShowCalc” is a “Yes” or “No” indicator whether or not to show the 
intermediate 
% calculations. 

X=X ' ; 

Y=Y ' ; 

Censored= (Y==a) ; 

NotCensored= (Y~=a) ; 

Ngamma=length (InitCoefs) ; 

NextGamma=InitCoef s /Ini t StdDev ; 

NextTheta=l /InitStdDev; 
n=length (Y) ; 

Error=l ; 

Gradntl= [] ; 

Gradnt2= [] ; 
while Error>Tol 
Gamma=NextGamma ; 

The ta=NextThe ta ; 

Gradnt_G= [0 ; 0] ; 

Gradnt_T= (n^2) / (2*Theta) ; 

Gradnt_GG= [0 , 0 ; 0 , 0] ; 

Gradnt_TG= [0 ; 0] ; 

Gradnt_TT= ( -n^2 ) / (2*Theta /N 2) ; 
for i=l:n 

Alpha (i) =a*Theta- (Gamma' ) *X ( : , i) ; 

Epsilon (i) =Theta*Y (i) - (Gamma' ) *X ( : f i) ; 

Lambda (i) =normpdf (Alpha (i) ) /normedf (Alpha (i) ) ; 

Delta (i) = (Lambda (i) *Alpha(i) -Lambda (i) "2) ; 
Gradnt_G=Gradnt_G+NotCensored ( i ) *Epsilon (i) *X ( : , i) - 
Censored (i) *Lambda (i) *X ( : , i) ; 

Gradnt_T=Gradnt_T-NotCensored(i) *Epsilon(i) *Y (i) +a*Lambda(i) ; 
Gradnt_GG=Gradnt_GG-NotCensored(i) *X ( : , i) * (X ( : , i) ' ) - 
Censored (i) *Delta (i) *X ( : , i) * (X ( : , i) '); 

Gradnt_TG=Gradnt_TG+NotCensored ( i) *Y(i) *X ( : , i) -a*Delta (i) *X ( : , i) ; 
Gradnt_TT=Gradnt_TT - NotCensored ( i ) *Y(i) "2+Censored (i) *Delta (i) *a"2 ; 
end; 

if ShowCalc== ' Y' 
format short g 

dispC Aphla Epsilon Lambda Delta'); 

disp ( [Alpha' , Epsilon' , Lambda' , Delta' ] ) ; 
format long g 
end; 

clear Alpha Epsilon Lambda Delta 
Gradl= [Gradnt_G; Gradnt_T] ; 
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dispP ’) 

disp ( ' Current Coefficients : ’ ) 
disp (Gamma/Theta) 
disp ( ’ ’ ) 

disp (' Current Std Dev:’) 
disp (1 /Theta) 
disp ( ’ ' ) 

Error=sum (Gradl . "2 ) 

disp ( ' ’ ) 

disp(’ ' ) 

disp ( ' ' ) 

disp ( ' ' ) 

disp(* ') 

Grad2= [Gradnt_GG, Gradnt_TG] ; 

Grad2= [Grad2 ; Gradnt__TG' , Gradnt_TT] ; 

Next Params= [Gamma; Theta] + (inv ( -Grad2) *Gradl) ; 
NextGamma=NextParams (1 : (Ngamma) , 1) ; 
NextTheta=NextParams ( (Ngamma+1) , 1) ; 
end; 

disp ( 1 ' ) 

disp ( ' GradFl : ' ) 

disp (Gradl) 

disp ( ’ ') 

disp ( ’Hessian: ' ) 

disp (Grad2) 

Coef s=Gamma/Theta; 

StdDev=l/Theta; 

J=eye (Ngamma) ; 

J=[J/Theta, ( -Gamma/ (Theta"2) ) ] ; 

J= [J; zeros (1, Ngamma) , (-1/ (Theta" 2) ) ] 

V=inv ( -Grad2) 

CovMatrx= J*V* J ' 
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APPENDIX S: OUTPUT OF CENSORED REGRESSION FUNCTION 



<<<<<<<<<<<<<<<<<<<<<<<<<<<< H~Time >>>>>>>>>>>>>>>>>>>>>>>> 



Aphla 


Epsilon 


Lambda 


Delta 


11.984 


-0.019406 


2 . 6l09e-32 


3 . 1288e -31 


10.071 


-1.9322 


3 . 7766e-23 


3 . 8034e -22 


11.85 


-0.1534 


1 . 2889e -31 


1 .5273e-30 


11.764 


-9.8874 


3 . 5347e- 31 


4 . 1583e - 3 0 


4.7565 


4.7565 


4 . 8766e - 06 


2 . 3195e - 05 


6.7717 


0.77014 


4 . 4004e - 11 


2 . 979 8e - 10 


3.1006 


-2.901 


0.0032643 


0.01011 


7.0372 


-4.8163 


7 . 0343e-12 


4 . 9502e - 11 


19.855 


13.853 


1 . 00l5e- 86 


1 .9885e-85 


9.5185 


3.5169 


8 . 4558e- 21 


8 . 0486e - 20 


33.105 


-8.3627 


4 . 114e -239 


1 .362e-237 


7.1688 


1.1673 


2 . 763e- 12 


1 .9807e-ll 


9.8947 


3.8932 


2 . 1934e- 22 


2 . 1703e- 21 


20.325 


-2 . 727 


7 . 8763e-9 1 


1 . 6009e- 89 


11.063 


5.0617 


1 . 0549e- 27 


1 .1671e-26 


12.266 


-8.7022 


8 . 4913e-34 


1 . 0416e-32 


3.3326 


3.3326 


0.0015466 


0.0051519 


3.1996 


3.1996 


0.0023888 


0.0076375 


1.5446 


1.5446 


0.1289 


0.18249 


6.3736 


6.3736 


6 . 023e - 10 


3 . 83 88e - 09 


3.8652 


-2.1364 


0.00022743 


0.000879 


4.3002 


-1.7014 


3 . 851e-05 


0.0001656 


8.1179 


8.1179 


1 .954e-15 


1 . 5862e-14 


2.219 


2.219 


0.034476 


0.075313 


12.727 


12.727 


2 . 683e-36 


3 . 4146e-35 


15.821 


3.8177 


1 . 7759e-55 


2 . 8096e - 54 


8.6888 


8.6888 


1 . 6l2e-17 


1 .4006e-16 


11.281 


-0.57233 


9 . 2386e-29 


1 . 0422e-27 


5.2245 


5.2245 


4 . 7186e - 07 


2 . 4652e - 06 


3.219 


3.219 


0.0022444 


0.0072196 


4.6822 


-1.3193 


6 . 9239e-06 


3 . 2419e- 05 


11.535 


5.5331 


5 . 1297e-30 


5 . 9l69e-29 


7.4839 


7.4839 


2 . 7473e -13 


2 . 056e- 12 


4.8686 


4.8686 


2 . 8427e-06 


1 .384e-05 


13.79 


7.7881 


2 . 0401e-42 


2 . 8l33e -41 


3.6365 


3.6365 


0.00053623 


0.0019497 



Current Coefficients : 

5.98263368946008 

-0.00255997229609403 

Current Std Dev: 

0.0527320088145204 

Error = 5 . 95730258181792e-ll 



GradFl : 

-1 .382142649679 69e-08 
-7 .71834255025583e-06 
-4 .802422212939 89e- 09 



Hessian: 

-22.2797993283313 

-16756.6236532761 

87 . 776141079539 



-16756.6236532761 

-13010602.3554909 

65479.3849930979 



87.776141079539 

65479.3849930979 

-361.259019184772 
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J = 

0.0527320088145204 

0 

0 

V = 

3.08028571493132 

-0.00228384901163305 

0.334470721458924 

CovMatrx = 
0.00418951052182767 
-5 .3734266455122e-06 
1 .04 749 7155729 85e- 05 



0 

0.0527320088145204 

0 



0.00228384901163305 
2 .56880468325853e-06 
8 .93090566 84 9174e-05 



-5.3734266455122e-06 
7. 1078943570 14 39e- 09 
-1. 23725774 239929e- 08 



-0.315476292446656 

0.000134992481682558 

-0.00278066475361465 

0.334470721458924 

-8.9309056684917e-05 

0.0678478482918518 



1. 04 7497155729 85e- 05 
-1.2372577423993e-08 
5 .24606108409868e-07 
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<<<<<<<<<<<<<<<<<<<<<<<<<<<<< G~Time >>>>>>>>>>>>>>>>>>>>>>>>>>>> 



Aphla 


Epsilon 


Lambda 


Delta 


9.3536 


2.0218 


4 . 004 6e - 20 


3 . 7458e-19 


8.4849 


-4.194 


9 . 2 84 8e - 17 


7 . 878e - 16 


9.2928 


9.2928 


7 . 0628e - 20 


6 . 5633e - 19 


9.254 


-4.8185 


1 . 0122e- 19 


9 . 3669e - 19 


6.0711 


6.0711 


3 . 9558e - 09 


2 . 4016e - 08 


6.9864 


1.4748 


1 . 0047e- 11 


7 . 0193e - 11 


5.319 


5.319 


2 . 8672e- 07 


1 . 5251e - 06 


7.107 


4.343 


4 . 2946e- 12 


3 . 0522e - 11 


12.929 


7.2339 


2 . 0196e-37 


2 . 6111e-36 


8.234 


5.9106 


7 . 5639e- 16 


6 . 22 81e - 15 


18.947 


5.8333 


4 . 4393e - 79 


8 . 4111e - 78 


7.1668 


4.6448 


2 . 803 6e - 12 


2 . 0093e- 11 


8.4048 


-8.2486 


1 . 8253e - 16 


1 . 5341e- 15 


13.142 


-1.0504 


1 . 2465e - 38 


1 . 6382e- 37 


8.9356 


8.9356 


1 . 8318e - 18 


1 .6368e-17 


9.482 


-7.6616 


1 . 1959e - 20 


1 .1339e-19 


5.4244 


5.4244 


1 . 6277e - 07 


8 . 8293e- 07 


5.364 


4.873 


2 . 2548e- 07 


1 .2095e-06 


4.6123 


4.6123 


9 . 5824e - 06 


4 . 4197e - 05 


6.8056 


1.2073 


3 . 4957e - 11 


2 . 379e - 10 


5.6663 


5.6663 


4 . 2564e- 08 


2 . 4118e - 07 


5.8638 


3.8697 


1 . 3627e - 08 


7 . 9905e- 08 


7.5978 


-11.057 


1 . 1632e - 13 


8 . 838e - 13 


4.9186 


2.3966 


2 . 2265e - 06 


1 . 0951e - 05 


9.6912 


-2.4947 


1 . 6087e-21 


1 . 5591e -20 


11 .096 


-0.39358 


7 . 299 8e -28 


8 . 1002e -27 


7.8571 


7.8571 


1 . 5683e-14 


1 . 2323e -13 


9.0346 


-6.9966 


7 . 5258e- 19 


6 . 7992e - 18 


6.2837 


6.2837 


1 . 0641e- 09 


6 . 6863e - 09 


5.3728 


-1.3872 


2 . 1505e- 07 


1 . 1554e- 06 


6.0374 


6.0374 


4 . 8521e- 09 


2 . 9294e - 08 


9.1497 


-3.7751 


2 . 6428e- 19 


2 . 4181e - 18 


7.3099 


4.8853 


9 . 951e- 13 


7 . 274e-12 


6.122 


5.126 


2 . 8998e- 09 


1 .7753e-08 


10.174 


-4.0337 


1 . 331 8e - 23 


1 .3549e-22 


5.5624 


2.2914 


7 . 6255e- 08 


4 . 2416e- 07 



Current Coefficients: 

6.21068116457626 

-0.00455346930467687 

Current Std Dev: 

0.206509463879223 

Error = 3 . 79556873919512e-23 



GradFl : 



0 

-6. 1390892369 672 7e- 12 
-5 .169823 328 74014e-13 



Hessian: 

-26.0000469060378 

-19034.6359576193 

74.8039173755412 



-19034.6359576193 

-14405957.8923267 

52620.7158448038 



74 . 8039173755412 
52620.7158448038 
-280.245923135296 
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o c. 



.206509463879223 

0 

0 

V = 

1.87497616538216 

-0.00206697555620314 

0.112364984307132 

CovMatrx = 

0 . 0502000309617088 
-6. 63294535171943e-05 
2 .26118834355422e-08 



0 

0.206509463879223 

0 

0.00206697555620314 
2.49960274112808e-06 
8. 23811561624 158e- 05 



-6.63294535171942e-05 
9 .060162256211 04 e- 08 
-2 . 7088717789066e-ll 



-1.28256443762143 
0 . 000940334504899319 
-0.042646158671684 

0.112364984307132 
-8 .23811561624 15 8e -05 
0.018092629273247 



2 .2611883435 6802e- 08 
-2.70887177893557e-ll 
3 .29049716722707e-05 
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<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< LTTime >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 



Aphla 


Epsilon 


Lambda 


Delta 


10.302 


-12.109 


3 . 5986e -24 


3 . 7072e - 23 


10.063 


-1.6977 


4 . 0958e -23 


4 . 12 15e - 22 


10.285 


4 . 6817 


4 . 2749e - 24 


4 . 39 67e - 23 


10.274 


-1.8374 


4 . 7704e-24 


4 . 9013e - 23 


9.3992 


9.3992 


2 . 6115e -20 


2 . 454 6e - 19 


9.6509 


9.6509 


2 . 3765e -21 


2 . 2935e - 20 


9.1925 


9.1925 


1 . 7852e-19 


1 .641e-18 


9.684 


-7.8264 


1 . 7247e -21 


1 .6702e-20 


11.285 


-1.8995 


8 . 8946e -29 


1 .0037e-27 


9.9939 


1.8233 


8 . 1808e -23 


8 . 1758e - 22 


12.939 


5.0156 


1 .7598e-37 


2 . 277e - 3 6 


9.7005 


2.2926 


1.4708e-21 


1 .4268e-20 


10 . 041 


-0.88917 


5 . 1098e - 23 


5 . 1307e -22 


11.343 


1.0901 


4 . 5761e - 29 


5 . 1908e -28 


10.187 


9.844 


1 .1681e-23 


1 .1899e-22 


10.337 


-4.3601 


2 . 5004e -24 


2 . 5847e - 23 


9.2214 


9.2214 


1 .3671e-19 


1 . 2607e - 18 


9.2048 


9.2048 


1 . 5932e-19 


1.4665e-18 


8.9982 


8.9982 


1 . 045e - 18 


9 . 4035e - 18 


9 . 6012 


-8.2671 


3 . 8349e -21 


3 . 6819e - 20 


9 .2879 


2 . 6226 


7 . 388e - 20 


6 . 8619e - 19 


9.3423 


4 .3044 


4 . 4544e-20 


4 . 1614e - 19 


9 . 819 


1.5231 


4 . 62 63e - 22 


4 . 5425e - 21 


9.0824 


4.3573 


4 . 8814e - 19 


4 . 43 35e - 18 


10.395 


0.92266 


1 . 3773e- 24 


1 .4316e-23 


10.781 


0.16462 


2 . 3 045e - 26 


2 . 4845e -25 


9.8903 


9.8903 


2 . 2915e - 22 


2 . 2664e - 21 


10.214 


-3.8281 


8 . 8494e - 24 


9 . 03 87e - 23 


9.4577 


9.4577 


1 . 5052e - 20 


1 .4236e-19 


9.2073 


9.2073 


1 .558e-19 


1 .4345e-18 


9 .39 


9.39 


2 . 8492e - 20 


2 . 6754e - 19 


10.246 


-8.7017 


6 . 402 le - 24 


6 . 5594e - 23 


9.7398 


4 . 1997 


1 . 0034e - 21 


9 . 7731e - 21 


9.4132 


1.4834 


2 . 2892e - 20 


2 . 1549e - 19 


10.527 


1.9015 


3 . 4369e - 25 


3 . 6181e -24 


9.2594 


5.1899 


9 . 6277e -20 


8 . 9147e - 19 



Current Coefficients: 

3.56042631224946 

-0.0011707103015085 

Current Std Dev: 

0.193119413640914 

Error = 1 . 07203388997578e-21 



GradFl : 

-3 . 3 75 0779 94 8604 8e -14 
-3 . 27418092638254e-ll 
8 .1712862560022e-14 



Hessian: 

-26 

-19314 .5 

69.9594 



-19314.5 

-14786409.3522 

51457.252257 



69.9594 

51457.252257 

-237.178213115407 
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o C| 



.193119413640914 

0 

0 

V = 

1.55969438215457 
-0 . 0017809772616 65 61 
0.0736622757710661 

CovMatrx = 

0 . 0483876157407601 
-6 .32055 14 061l848e-05 
1 . 12757025938492e-17 



0 

0 . 193119413640914 
0 

-0.00178097726166561 
2 .30971136831878e-06 
-2.42210279092273e-05 



-6 .320 5514 06 1184 8e -05 
8. 508340187 894 le- 08 
-1. 5008365034162 le -20 



-0.687587441733296 

0.000226086886970699 

-0.0372951079250102 

0 . 0736622757710664 
-2.42210279092277e-05 
0.0206891729559566 



9 .05753789592455e-18 
-1.27624348 14 291e-20 
2 .877 708944 83 103e- 05 
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<<<<<<<<<<<<<<<<<<<<<<<<<<<<< T~Time >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 



Aphla 


Epsilon 


Lambda 


Delta 


9.5468 


9.5468 


6 . 4566e-21 


6 . 164e -20 


9.4357 


9.4357 


1 . 8519e- 20 


1 . 7474e - 19 


9.539 


9.539 


6 . 954e - 21 


6 . 6334e-20 


9.534 


-10.657 


7 . 2908e-21 


6 . 9511e - 2 0 


9.1273 


9.1273 


3 . 2433e - 19 


2 . 9602e -18 


9.2442 


8.1697 


1 . 1076e- 19 


1 . 0239e - 18 


9.0312 


9.0312 


7 . 7617e - 19 


7 . 0098e - 18 


9.2597 


-5.1526 


9 . 603 8e - 2 0 


8 . 8928e - 19 


10.004 


10.004 


7 . 423 le-23 


7 . 4258e - 22 


9.4037 


9.4037 


2 . 505e- 20 


2 . 3556e- 19 


10.773 


6.4979 


2.5165e-26 


2 . 7109e - 25 


9.2673 


9.2673 


8 . 94 8e - 20 


8 . 2923e - 19 


9.4255 


9.4255 


2 . 0395e-20 


1 . 9223e - 19 


10.031 


10.031 


5 . 6468e-23 


5 . 6643e-22 


9.4933 


9 .4933 


1 . 0737e-20 


1 . 0193e-19 


9.5632 


-9.6499 


5 . 5202e- 21 


5 . 2 79e - 20 


9.0446 


9.0446 


6 . 8722e - 19 


6 . 2156e - 18 


9.0369 


7.9624 


7 . 3 69e- 19 


6.6593e-18 


8.9409 


8.9409 


1 . 7474e- 18 


1 . 5623e - 17 


9.2211 


-3.9064 


1 . 3709e- 19 


1 .2642e- 18 


9.0755 


9 .0755 


5 . 1936e- 19 


4 . 7l35e - 18 


9.1008 


9.1008 


4 . 1288e- 19 


3 . 7575e - 18 


9.3224 


5.0476 


5 . 3 624e -20 


4 . 999e - 19 


8.98 


8.98 


1 . 2305e-18 


1 . 105e - 17 


9.5899 


9.5899 


4 . 273 le - 21 


4.097 8e - 2 0 


9.7695 


9.7695 


7 . 5135e-22 


7 . 3403e - 21 


9.3555 


9.3555 


3 . 9351e - 20 


3 . 6815e - 19 


9.506 


-10.378 


9 . 5212e-21 


9 . 050 8e - 20 


9.1544 


9 . 1544 


2 . 5302e-l9 


2 . 3162e - 18 


9.038 


7.9635 


7 . 2943e - 19 


6.5926e-18 


9.123 


9.123 


3 . 3 734e - 19 


3 . 0775e - 18 


9.5207 


-1.2741 


8 . 2779e - 21 


7 . 8811e - 20 


9.2856 


9.2856 


7 . 5518e - 20 


7 . 0123e - 19 


9.1338 


9.1338 


3 . 05 61e - 19 


2 . 79 14e - 18 


9.6516 


5.3768 


2 . 3606e-21 


2 . 2784e - 20 


9.0623 


9.0623 


5 . 8579e - 19 


5 . 3 086e - 18 



Current Coefficients: 

3.53892707621323 

-0.000424821448308802 

Current Std Dev: 

0.150767399551903 

Error = 6 . 78351626339064e-17 



GradFl : 

1.06575552500 29 5e- 14 
8. 1851 04 1128211 le- 12 
8.23620638630817e-09 



Hessian: 

-12 

-8880.26 

38.6946 



-8880.26 

-6861224.772 

28511.797113 



38.6946 

28511.797113 

-154.284072861433 
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J = 

0.150767399551903 

0 

0 

V = 

2.39919865995144 

-0.00260600466439869 

0.120130068235466 



0 

0.150767399551903 

0 

-0.0026060046643987 
3.45868842729863e-06 
-1 .44207067492995e-05 



-0.533554832484488 
6 .40492250353914e-05 
-0 . 0227308087676432 

0.120130068235466 
-1 .4420706749299e-05 
0.0339453358739479 



CovMatrx = 
0.0448721419447545 
-5 .80765534533235e-05 
-3 .79470760369927e-19 



-5 .80765534533235e-05 
7.8479531166867e-08 
6.28657265540301e-22 



8 . 674 96687137743e-19 
-1 .039702 1729722 6e- 21 
1 .75392042967603e-05 
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<<<<<<<<<<<<<<<<<<<<<<<<<<<<< H~CSFIQM >>>>>>>>>>>>>>>>>>>>>>>>>>>>> 



Aphla 


Epsilon 


Lambda 


Delta 


3.4087 


-2.4791 


0.0011966 


0.0040774 


3.4206 


-2.4672 


0.0011489 


0.0039287 


3.3973 


-2.4906 


0.0012441 


0.0042249 


3.4408 


-7.1799 


0.001072 


0.0036873 


3.4106 


3.4106 


0.0011888 


0.0040531 


3.4305 


0.48653 


0.0011107 


0.0038092 


3.4203 


0.47631 


0.0011503 


0.0039331 


3 .4141 


-2.4004 


0.0011747 


0.0040092 


3.4221 


0.47811 


0.0011433 


0.003911 


3.4359 


0.49194 


0.0010903 


0.003745 


3.4192 


-16.922 


0.0011546 


0.0039465 


3.4429 


0.49892 


0.0010644 


0.0036636 


3.4156 


0.47162 


0.0011689 


0.0039912 


3.3849 


-7.9227 


0.0012974 


0.00439 


3.4276 


0.48365 


0.0011218 


0.0038438 


3.4394 


-6.8462 


0.0010773 


0.0037041 


3.4281 


3.428 


0.0011199 


0.003838 


3.4141 


3.4141 


0.0011747 


0.0040092 


3.4103 


3.4102 


0.0011902 


0.0040576 


3.4645 


3.4645 


0.00098776 


0.0034211 


3.3653 


0.42136 


0.0013862 


0.0046631 


3.4236 


0.47968 


0.0011372 


0.0038919 


3.4033 


3.4033 


0.0012189 


0.0041467 


3.3908 


3.3908 


0.0012718 


0.0043107 


3 .428 


3.4279 


0.0011204 


0.0038395 


3.3984 


-2.4895 


0.0012395 


0.0042107 


3.4116 


3.4116 


0.0011849 


0.0040409 


3.4531 


-2.3614 


0.0010276 


0.0035473 


3.4393 


3.4392 


0.0010777 


0.0037055 


3.429 


3.429 


0.0011163 


0.0038264 


3.4063 


0.46236 


0.0012065 


0.0041081 


3.4295 


0.48557 


0.0011144 


0.0038207 


3.4146 


3 .4146 


0.0011728 


0.0040032 


3.4399 


3.4398 


0.0010755 


0.0036985 


3.4141 


0.47018 


0.0011747 


0.0040092 


3.3694 


3.3694 


0.0013672 


0.0046049 



Current Coefficients: 

9 .09762576101784 
-12.9266899736184 

Current Std Dev: 

0.107501011896347 

Error = 1 . 01525409396449e-ll 

GradFl : 

7. 66089556236693e-07 
2 . 85194 845517367e- 07 
3 . 07966096048905e-06 



Hessian: 

-36 

-13.402253 

153.603951914641 



-13.402253 

-4.989456220079 

57.1844110631026 



153.603951914641 

57.1844110631026 

-676.068838723457 
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^ o 



.107501011896347 

0 

0 

V = 

129777.49518052 
-348593 . 68720298 
0.312728942970085 



0 

0.107501011896347 

0 

-348593.68720298 

936359.644683127 

-0.28568453724249 



-0.978003975163692 

1.38963225263435 

-0.0115564675587385 

0.312728942961257 

-0.285684537215275 

0.0483674111766335 



CovMatrx = 

1499.74991753792 -4028.50061839228 

-4028.50061839228 10821.0179032868 

0 . 000158148439328746 -0.000421828836398579 



0.000158148439339712 
-0.000421828836432389 
6. 4 595 6171324 861e- 06 
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<<<<<<<<<<<<<<<<<<<<<<<<<<<<< H~G >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 



Aphla 


Epsilon 


Lambda 


Delta 


4.5505 


-2.5211 


1 .2719e-05 


5 . 7879e-05 


6.67 


-0.40166 


8 . 7168e - 11 


5 . 8141e- 10 


1.6442 


-5.4274 


0.10869 


0.16689 


7.2224 


-5.5337 


1 .8787e-12 


1 . 3569e- 11 


1.6442 


1.6442 


0.10869 


0.16689 


3.829 


0.29311 


0.00026144 


0.001001 


1 . 6442 


-1.8916 


0.10869 


0.16689 


2.7398 


-4.2437 


0.0093795 


0.02561 


3.9015 


0.36567 


0.0001975 


0.00077051 


2.5652 


-0.97067 


0.014939 


0.038097 


6.8423 


-17.589 


2 . 7202e - 11 


1 .8612e-10 


2.6439 


-0.89197 


0.012157 


0.031994 


8.2455 


4.7096 


6.8791e-16 


5 . 6721e- 15 


7.27 


-6 .3111 


1 .3306e-12 


9 . 6736e- 12 


1 . 6442 


-1.8916 


0.10869 


0.16689 


8.4397 


-3.9138 


1 .3606e-16 


1 . 1483e-15 


1.6442 


1.6442 


0.10869 


0.16689 


1.8388 


1.8388 


0.076072 


0.1341 


1.6442 


1.6442 


0.10869 


0.16689 


3.8633 


3.8633 


0.00022907 


0.00088493 


1.6442 


-1.8916 


0.10869 


0.16689 


2.4346 


-1.1012 


0.02075 


0.050089 


9.039 


9.0389 


7 . 2321e-19 


6 . 5371e-l8 


2.6439 


2.6438 


0.012157 


0.031994 


6.4746 


6.4745 


3 . 1484e -10 


2 . 0385e-09 


6.1987 


-0.87289 


1 . 8079e - 09 


1 .1207e-08 


1.6442 


1.5442 


0.10869 


0.16689 


7.9988 


1.0153 


5 . le -15 


4 . 0794e - 14 


1.6442 


1.6442 


0.10869 


0.16689 


4.3238 


4.3237 


3 . 4 778e - 05 


0.00015037 


1.6442 


-1.8916 


0.10869 


0.16689 


6.7675 


3.2316 


4 . 5272e - 11 


3 . 0638e - 10 


2.6053 


2.6052 


0.013459 


0.034884 


2.039 


2.039 


0.050954 


0.1013 


7.2759 


3.7401 


1 . 2743e -12 


9 . 2715e- 12 


2.9408 


2.9408 


0.0052924 


0.015536 



Current Coefficients: 

3.70618334057552 

0.171803772335592 

Current Std Dev: 

0.0895055145543749 

Error = 7 . 87845369785913e- 11 

GradFl : 

-1.37111956632907e-06 
- 6. 2814 173933389 8e- 06 
-6.11950681379467e-06 

Hessian: 

-36 -121.3312 144.332468083947 

-121.3312 -469.08840062 484.750954950162 

144.332468083947 484.750954950162 -673.771529409291 
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J = 

0.0895055145543749 

0 

0 

V = 

0.393768787744777 

-0.0572341316549663 

0.0431738649444602 

CovMatrx = 

0 . 00174 8394 892544 75 
-0.000455482138818791 
-3 .0018 8 75512 6733e-0 6 



0 

0.0895055145543749 

0 

-0 . 0572341316549664 
0 . 0166294378087581 
-0 . 00029625416570 8113 



-0.000455482138818791 
0 . 0001365253722 03802 
1 .50835355028727e-06 



-0.331723846931064 

-0.0153773850452798 

-0.00801123713564342 

0.0431738649444601 
-0 .00 029 625416570 8101 
0 .0105195614315077 



-3 . 0018875512673e-06 
1 .50835355028727e-06 
6 .751446157748 04e- 07 
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<<<<<<<<<<<<<<<<<<<<<<<<<< 


H~L >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 


Aphla 


Epsilon 


Lambda 


Delta 


8.2702 


1 . 6451 


5 . 6064e - 16 


4 . 6367e - 15 


5 .1446 


-1.4805 


7 . 1382e - 07 


3 . 6724e - 06 


3.3376 


-3 .2875 


0.0015209 


0.005074 


5 .2477 


-6 . 7031 


4 . 1791e - 07 


2 . 193 le - 06 


1.6932 


1 . 6932 


0.09964 


0.15878 


1.6932 


-1 . 6194 


0.09964 


0.15878 


1.6932 


-1 . 6194 


0.09964 


0 . 15878 


6.8321 


0 .28942 


2 . 9183e - 11 


1 . 9938e - 10 


5.5624 


2.2498 


7 . 6264e - 08 


4 . 2421e - 07 


4.0911 


0.77846 


9 . 2586e - 05 


0.00037877 


4 . 0186 


-18.87 


0.00012422 


0 . 00049918 


3.8672 


0.55462 


0.00022563 


0.0008725 


4.9009 


1.5883 


2 . 4283e - 06 


1 . 1901e - 05 


4.7023 


-8 . 0214 


6.302e-06 


2 . 9 634e - 05 


1.7938 


-1.5188 


0.082847 


0.14175 


6.0064 


-5.5672 


5 . 8456e - 09 


3 . 5111e - 08 


1.6932 


1.6932 


0.09964 


0.15878 


1.6932 


1.6932 


0.09964 


0.15878 


1.6932 


1.6932 


0.09964 


0.15878 


6.9371 


6.937 


1.4163e-ll 


9 . 8251e- 11 


3.6493 


0.3367 


0.00051181 


0.0018675 


3.1717 


-0.14092 


0.0026111 


0.0082747 


4.1279 


4.1278 


7 . 96e - 05 


0 . 00032857 


3.0799 


3.0799 


0.0034797 


0.010705 


4 .473 


4.4729 


1 .8045e-05 


8 . 0715e - 05 


4.8088 


-1.8164 


3 . 7972e - 0 6 


1 . 826e- 05 


1.6932 


1.6932 


0.09964 


0.15878 


5.8142 


-0.72844 


1 . 8208e-08 


1 . 0587e - 07 


1.6932 


1.6932 


0.09964 


0.15878 


1.6932 


1.6932 


0.09964 


0.15878 


1.6932 


-1.6194 


0.09964 


0.15878 


7.2538 


3.9411 


1 . 4972e -12 


1 . 086e - 11 


3.3191 


3.3191 


0.0016178 


0.005367 


4.0204 


4 . 0204 


0.00012331 


0.00049576 


4.2247 


0.91204 


5 . 3l3e - 05 


0.00022445 


2.8875 


2.8875 


0.0061835 


0.017817 



Current Coefficients: 

3 . 81544472859719 
0.145182166352519 



Current Std Dev: 

0.095536985862006 

Error = 8 . 13798271668736e - 11 

GradFl : 

-1.38276209327159e-06 
-6 . 38748018744 195e-06 
-6.21835131005971e-06 

Hessian : 

-36 -116.4864 145.978272113953 

-116.4864 -429.48715608 468.509148871197 

145.978272113953 468.509148871197 -674.494748297997 
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J = 

0.095536985862006 

0 

0 

V = 

0.450746091372439 

-0.0653603524663376 

0.0521534267916938 

CovMatrx = 
0.00209652138696284 
-0.000573327948904799 
-5 . 04169 819 527686e- 06 



0 

0.095536985862006 

0 

-0.0653603524663376 

0.0190876683112434 

-0.000887247950956856 



-0 . 000573327948904799 
0.000178908774495219 
2 .3123102359 1529e- 06 



-0.364516089093255 

-0.013870266574236 

-0.00912731566759714 

0.0521534267916939 

-0.000887247950956868 

0.0121536651934179 



-5 .04169819527687e-06 
2 .3123102359153e-06 
1 .0124962l87808e-06 
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